02.12.2021 17:25:00,043 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:00,045 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239809ms for 240000ms of delay, sleeping for 201ms
02.12.2021 17:25:00,089 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:00,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:00,095 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:00,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:00,184 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59209ms delay out of 60000ms. Remaining 791ms. Executor queue at 0
02.12.2021 17:25:00,185 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59196ms for 60000ms of delay, sleeping for 814ms
02.12.2021 17:25:00,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:00,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:00,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:00,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 92 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:00,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 35637ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:00,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:00,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 93 iterations.
02.12.2021 17:25:00,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 93 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:00,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 35637ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:00,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:00,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:00,199 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=928): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=185, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', members=[])
02.12.2021 17:25:00,199 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=185, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', members=[])
02.12.2021 17:25:00,199 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:00,199 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=185, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}
02.12.2021 17:25:00,199 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=185, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=185, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:00,199 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019374, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:00,199 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019384, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:00,200 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=929) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:00,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:00,200 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:00,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,200 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:00,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 93 iterations.
02.12.2021 17:25:00,200 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119425ms for 120000ms of delay, sleeping for 585ms
02.12.2021 17:25:00,201 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=929): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:00,201 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=185, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}
02.12.2021 17:25:00,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,215 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,216 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,240 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:00,256 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239127ms for 240000ms of delay, sleeping for 883ms
02.12.2021 17:25:00,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,285 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,287 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,292 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 144
02.12.2021 17:25:00,340 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:00,385 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:00,387 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:00,391 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,391 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:00,391 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=849) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:00,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 44
02.12.2021 17:25:00,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,438 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,438 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,439 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 185 and member id staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,438 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 185 and member id staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,439 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=641) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null}
02.12.2021 17:25:00,439 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=641) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null}
02.12.2021 17:25:00,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 355
02.12.2021 17:25:00,440 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=641): org.apache.kafka.common.requests.HeartbeatResponse@1f6daedb
02.12.2021 17:25:00,440 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 302
02.12.2021 17:25:00,440 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:00,441 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 185 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39
02.12.2021 17:25:00,440 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=641): org.apache.kafka.common.requests.HeartbeatResponse@3ed97265
02.12.2021 17:25:00,441 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:00,441 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:00,441 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:00,441 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 185 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a
02.12.2021 17:25:00,441 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 77, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,441 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:00,442 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:00,442 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=642) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:00,442 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 77, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,442 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=642) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:00,442 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 351
02.12.2021 17:25:00,442 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:00,486 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:00,488 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:00,492 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=849): org.apache.kafka.common.requests.HeartbeatResponse@1be3c318
02.12.2021 17:25:00,492 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:00,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:00,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,503 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,541 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:00,541 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:00,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:00,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:00,686 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:00,689 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:00,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,722 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,722 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,742 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,742 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:00,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,786 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,786 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,787 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,787 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,788 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119861ms for 120000ms of delay, sleeping for 149ms
02.12.2021 17:25:00,798 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:00,798 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,798 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,799 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:00,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:00,888 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:00,943 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119978ms for 120000ms of delay, sleeping for 32ms
02.12.2021 17:25:00,985 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119725ms for 120000ms of delay, sleeping for 285ms
02.12.2021 17:25:00,987 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:00,994 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:01,003 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59917ms for 60000ms of delay, sleeping for 93ms
02.12.2021 17:25:01,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,005 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,005 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,087 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:01,095 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:01,097 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59113ms for 60000ms of delay, sleeping for 897ms
02.12.2021 17:25:01,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 10 records with 58 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:01,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 161865ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:01,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:01,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 59 iterations.
02.12.2021 17:25:01,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 59 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:01,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 161866ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:01,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:01,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:01,141 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962135, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:01,141 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962145, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:01,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:01,142 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-3, new queue size is 10
02.12.2021 17:25:01,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,142 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:01,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 59 iterations.
02.12.2021 17:25:01,143 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239549ms for 240000ms of delay, sleeping for 461ms
02.12.2021 17:25:01,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:01,195 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:01,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:01,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,224 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,243 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,272 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119282ms for 120000ms of delay, sleeping for 728ms
02.12.2021 17:25:01,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,287 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,287 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,299 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,300 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,387 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:01,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:01,487 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:01,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:01,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,506 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:01,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:01,606 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239292ms for 240000ms of delay, sleeping for 718ms
02.12.2021 17:25:01,688 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:01,694 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:01,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:01,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,731 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,746 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:01,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,791 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,793 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:01,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,796 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,796 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,804 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,897 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:01,894 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:01,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:01,998 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:02,001 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119819ms for 120000ms of delay, sleeping for 191ms
02.12.2021 17:25:02,009 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58921ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:02,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,010 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:02,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:02,194 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119756ms for 120000ms of delay, sleeping for 254ms
02.12.2021 17:25:02,199 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:02,199 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:02,235 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:02,235 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,235 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,235 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,235 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,235 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,235 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,235 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:02,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,251 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,251 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:02,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,293 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 51
02.12.2021 17:25:02,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:02,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,296 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 30
02.12.2021 17:25:02,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:02,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,306 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,307 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,327 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239356ms for 240000ms of delay, sleeping for 654ms
02.12.2021 17:25:02,328 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:02,328 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:02,329 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=627) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:02,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 468
02.12.2021 17:25:02,329 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=627): org.apache.kafka.common.requests.HeartbeatResponse@4bbce8cc
02.12.2021 17:25:02,329 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:02,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 467
02.12.2021 17:25:02,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 467
02.12.2021 17:25:02,345 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:02,345 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:02,357 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=627) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:02,358 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 448
02.12.2021 17:25:02,359 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=627): org.apache.kafka.common.requests.HeartbeatResponse@2383ccbf
02.12.2021 17:25:02,359 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:02,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 434
02.12.2021 17:25:02,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 429
02.12.2021 17:25:02,430 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 366
02.12.2021 17:25:02,449 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119969ms for 120000ms of delay, sleeping for 41ms
02.12.2021 17:25:02,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 329
02.12.2021 17:25:02,491 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119406ms for 120000ms of delay, sleeping for 604ms
02.12.2021 17:25:02,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,512 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 266
02.12.2021 17:25:02,565 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 228
02.12.2021 17:25:02,632 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 164
02.12.2021 17:25:02,665 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 128
02.12.2021 17:25:02,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 63
02.12.2021 17:25:02,735 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:02,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,737 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,737 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,752 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,752 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 27
02.12.2021 17:25:02,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:02,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,796 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:02,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:02,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,797 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:02,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,807 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,897 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:02,898 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:02,996 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239931ms for 240000ms of delay, sleeping for 79ms
02.12.2021 17:25:03,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 290
02.12.2021 17:25:03,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 290
02.12.2021 17:25:03,009 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59921ms delay out of 60000ms. Remaining 79ms. Executor queue at 0
02.12.2021 17:25:03,010 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59671ms for 60000ms of delay, sleeping for 339ms
02.12.2021 17:25:03,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,013 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,013 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,076 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238884ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:03,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 93 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:03,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 38534ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:03,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:03,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 94 iterations.
02.12.2021 17:25:03,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 94 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:03,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 38535ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:03,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:03,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:03,098 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:03,098 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:03,098 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:03,098 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 77, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 6])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:03,099 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=930) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:03,100 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019384, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:03,100 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019394, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:03,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:03,100 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:03,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,100 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:03,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 94 iterations.
02.12.2021 17:25:03,103 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119960ms for 120000ms of delay, sleeping for 50ms
02.12.2021 17:25:03,107 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:03,107 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:03,108 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:03,154 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119023ms for 120000ms of delay, sleeping for 987ms
02.12.2021 17:25:03,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:03,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:03,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,239 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,253 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,253 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,297 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,297 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,298 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,298 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,309 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,309 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,351 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59276ms for 60000ms of delay, sleeping for 734ms
02.12.2021 17:25:03,398 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:03,398 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:03,409 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:03,409 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:03,409 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=850) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:03,498 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:03,499 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:03,509 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=850): org.apache.kafka.common.requests.HeartbeatResponse@3fc860a7
02.12.2021 17:25:03,510 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:03,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 512 ms and fetched 0 records
02.12.2021 17:25:03,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,525 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:03,599 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:03,600 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:03,700 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:03,699 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:03,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,742 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,742 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:03,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,761 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:03,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,800 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,800 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:03,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,804 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,807 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,818 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,900 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:03,914 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 390
02.12.2021 17:25:03,964 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=635): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', members=[])
02.12.2021 17:25:03,964 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=635): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', members=[])
02.12.2021 17:25:03,978 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', members=[])
02.12.2021 17:25:03,981 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:03,981 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=55, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', protocol='stream'}
02.12.2021 17:25:03,977 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', members=[])
02.12.2021 17:25:03,983 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:03,983 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=55, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', protocol='stream'}
02.12.2021 17:25:03,981 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=55, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=55, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:03,991 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=636) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null,assignments=[]}
02.12.2021 17:25:03,990 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=55, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=55, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:03,992 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=636) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null,assignments=[]}
02.12.2021 17:25:03,995 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 31
02.12.2021 17:25:03,992 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 251
02.12.2021 17:25:04,014 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 286
02.12.2021 17:25:04,015 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 289
02.12.2021 17:25:04,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,026 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,026 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,041 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=636): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:04,041 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:04,041 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=55, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', protocol='stream'}
02.12.2021 17:25:04,041 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 55 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce
02.12.2021 17:25:04,041 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:04,041 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:04,041 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:04,041 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:04,041 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:04,041 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7] State transition from RUNNING to REBALANCING
02.12.2021 17:25:04,041 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:04,041 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 485
02.12.2021 17:25:04,039 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=636): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:04,043 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:04,046 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=55, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', protocol='stream'}
02.12.2021 17:25:04,047 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 55 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477
02.12.2021 17:25:04,047 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:04,047 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:04,047 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:04,047 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:04,047 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:04,047 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:04,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:04,077 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239885ms delay out of 240000ms. Remaining 115ms. Executor queue at 0
02.12.2021 17:25:04,078 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239720ms for 240000ms of delay, sleeping for 290ms
02.12.2021 17:25:04,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 10 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:04,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:04,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 0 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:04,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:04,087 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1129545, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:04,087 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1129555, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:04,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:04,087 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-4, new queue size is 10
02.12.2021 17:25:04,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,087 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:04,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:04,087 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59808ms for 60000ms of delay, sleeping for 202ms
02.12.2021 17:25:04,115 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 185
02.12.2021 17:25:04,117 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 187
02.12.2021 17:25:04,143 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119936ms for 120000ms of delay, sleeping for 74ms
02.12.2021 17:25:04,142 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 384
02.12.2021 17:25:04,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:04,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 85
02.12.2021 17:25:04,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:04,219 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119343ms for 120000ms of delay, sleeping for 667ms
02.12.2021 17:25:04,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:04,243 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:04,243 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:04,243 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:04,243 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:04,243 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:04,243 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:04,243 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:04,243 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:04,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:04,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 283
02.12.2021 17:25:04,244 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,262 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,291 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59558ms for 60000ms of delay, sleeping for 452ms
02.12.2021 17:25:04,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,301 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,305 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,305 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,319 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 182
02.12.2021 17:25:04,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:04,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 10 records with 59 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:04,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 165093ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:04,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:04,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 60 iterations.
02.12.2021 17:25:04,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 60 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:04,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 165094ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:04,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:04,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:04,370 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1184): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', members=[])
02.12.2021 17:25:04,370 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', members=[])
02.12.2021 17:25:04,370 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:04,370 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=55, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', protocol='stream'}
02.12.2021 17:25:04,370 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=55, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=55, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:04,371 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1185) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null,assignments=[]}
02.12.2021 17:25:04,371 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962145, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:04,372 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962155, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:04,372 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1185): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:04,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 4 ms and fetched 10 records
02.12.2021 17:25:04,373 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-3, new queue size is 10
02.12.2021 17:25:04,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,373 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:04,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 60 iterations.
02.12.2021 17:25:04,374 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239293ms for 240000ms of delay, sleeping for 717ms
02.12.2021 17:25:04,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:04,405 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:04,445 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 81
02.12.2021 17:25:04,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 295
02.12.2021 17:25:04,472 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=55, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', protocol='stream'}
02.12.2021 17:25:04,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:04,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:04,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:04,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:04,532 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:04,532 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:04,537 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:04,537 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:04,538 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:04,538 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:04,538 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:04,538 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:04,539 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7] State transition from REBALANCING to RUNNING
02.12.2021 17:25:04,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:04,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,539 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,540 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:04,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:04,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:04,641 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:04,650 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:04,703 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:04,708 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:04,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:04,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,744 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,744 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,745 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 295
02.12.2021 17:25:04,755 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59700ms for 60000ms of delay, sleeping for 310ms
02.12.2021 17:25:04,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:04,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,768 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,769 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,802 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,803 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,803 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,804 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:04,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,806 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,822 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,822 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 193
02.12.2021 17:25:04,845 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:04,896 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119986ms for 120000ms of delay, sleeping for 24ms
02.12.2021 17:25:04,905 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:04,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:04,922 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119992ms for 120000ms of delay, sleeping for 18ms
02.12.2021 17:25:04,948 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:04,953 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118826ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:04,950 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 294
02.12.2021 17:25:05,010 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:05,014 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:05,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:05,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,044 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,055 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 189
02.12.2021 17:25:05,069 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59185ms for 60000ms of delay, sleeping for 825ms
02.12.2021 17:25:05,093 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239778ms for 240000ms of delay, sleeping for 232ms
02.12.2021 17:25:05,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:05,115 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:05,137 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=642): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', members=[])
02.12.2021 17:25:05,137 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', members=[])
02.12.2021 17:25:05,137 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:05,137 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=186, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}
02.12.2021 17:25:05,137 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=186, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=186, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:05,137 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=643) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null,assignments=[]}
02.12.2021 17:25:05,137 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 132
02.12.2021 17:25:05,137 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=642): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', members=[])
02.12.2021 17:25:05,137 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', members=[])
02.12.2021 17:25:05,138 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:05,138 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=186, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}
02.12.2021 17:25:05,138 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=186, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=186, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:05,138 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=643) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null,assignments=[]}
02.12.2021 17:25:05,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 184
02.12.2021 17:25:05,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:05,157 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 87
02.12.2021 17:25:05,185 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=643): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,185 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,185 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=186, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}
02.12.2021 17:25:05,186 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 186 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39
02.12.2021 17:25:05,186 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:05,186 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:05,186 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:05,186 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:05,186 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:05,186 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7] State transition from RUNNING to REBALANCING
02.12.2021 17:25:05,186 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:05,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 137
02.12.2021 17:25:05,186 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=643): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,186 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,187 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=186, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}
02.12.2021 17:25:05,187 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 186 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a
02.12.2021 17:25:05,187 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:05,187 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:05,187 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:05,187 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:05,187 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:05,188 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:05,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 83
02.12.2021 17:25:05,213 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:05,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:05,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:05,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,244 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:05,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:05,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:05,271 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:05,271 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:05,271 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:05,271 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:05,271 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:05,271 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:05,271 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:05,271 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:05,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:05,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,271 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,286 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 36
02.12.2021 17:25:05,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,305 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,305 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 40
02.12.2021 17:25:05,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,308 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,308 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 20
02.12.2021 17:25:05,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:05,323 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:05,323 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:05,323 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:05,323 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:05,323 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:05,323 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:05,323 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:05,323 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:05,323 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7] State transition from REBALANCING to RUNNING
02.12.2021 17:25:05,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:05,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,323 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,323 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,327 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239758ms for 240000ms of delay, sleeping for 252ms
02.12.2021 17:25:05,328 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:05,328 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:05,329 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=628) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:05,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 480
02.12.2021 17:25:05,329 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=628): org.apache.kafka.common.requests.HeartbeatResponse@41eac1f5
02.12.2021 17:25:05,329 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:05,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 479
02.12.2021 17:25:05,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 478
02.12.2021 17:25:05,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:05,345 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:05,346 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:05,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:05,346 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=628) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:05,348 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 460
02.12.2021 17:25:05,348 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=628): org.apache.kafka.common.requests.HeartbeatResponse@6320a486
02.12.2021 17:25:05,349 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:05,349 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 456
02.12.2021 17:25:05,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 455
02.12.2021 17:25:05,372 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:05,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:05,430 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 378
02.12.2021 17:25:05,447 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:05,447 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:05,451 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 354
02.12.2021 17:25:05,472 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:05,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:05,530 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 278
02.12.2021 17:25:05,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:05,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,546 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,547 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:05,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 253
02.12.2021 17:25:05,572 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 200
02.12.2021 17:25:05,583 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239464ms for 240000ms of delay, sleeping for 546ms
02.12.2021 17:25:05,625 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:05,631 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 177
02.12.2021 17:25:05,647 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:05,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:05,652 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 153
02.12.2021 17:25:05,674 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:05,726 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:05,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 76
02.12.2021 17:25:05,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,745 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,745 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,748 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:05,753 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 52
02.12.2021 17:25:05,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,773 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:05,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,816 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,817 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:05,809 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:05,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,817 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,817 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:05,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:05,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,827 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,845 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:05,849 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:05,876 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 397
02.12.2021 17:25:05,896 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59819ms for 60000ms of delay, sleeping for 191ms
02.12.2021 17:25:05,917 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:05,918 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:05,931 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 397
02.12.2021 17:25:05,952 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 293
02.12.2021 17:25:05,953 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119827ms delay out of 120000ms. Remaining 173ms. Executor queue at 0
02.12.2021 17:25:05,961 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 85
02.12.2021 17:25:05,965 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119721ms for 120000ms of delay, sleeping for 289ms
02.12.2021 17:25:05,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 292
02.12.2021 17:25:06,018 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:06,017 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:06,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:06,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:06,052 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 193
02.12.2021 17:25:06,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,054 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:06,096 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 177
02.12.2021 17:25:06,099 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59848ms for 60000ms of delay, sleeping for 162ms
02.12.2021 17:25:06,119 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:06,119 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:06,132 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 195
02.12.2021 17:25:06,133 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239943ms for 240000ms of delay, sleeping for 67ms
02.12.2021 17:25:06,153 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:06,155 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:06,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 77
02.12.2021 17:25:06,201 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239959ms for 240000ms of delay, sleeping for 51ms
02.12.2021 17:25:06,219 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:06,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:06,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:06,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,245 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,246 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:06,253 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239134ms for 240000ms of delay, sleeping for 876ms
02.12.2021 17:25:06,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:06,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 94 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:06,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 41700ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:06,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:06,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 95 iterations.
02.12.2021 17:25:06,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 95 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:06,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 41700ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:06,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:06,263 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59338ms for 60000ms of delay, sleeping for 672ms
02.12.2021 17:25:06,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:06,265 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=930): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', members=[])
02.12.2021 17:25:06,265 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', members=[])
02.12.2021 17:25:06,265 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:06,265 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=186, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}
02.12.2021 17:25:06,265 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=186, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=186, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:06,265 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019394, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:06,265 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019404, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:06,265 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=931) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:06,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:06,266 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:06,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,266 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:06,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 95 iterations.
02.12.2021 17:25:06,268 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119920ms for 120000ms of delay, sleeping for 90ms
02.12.2021 17:25:06,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,274 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,317 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,318 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,318 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,318 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,329 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:06,355 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:06,362 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119320ms for 120000ms of delay, sleeping for 690ms
02.12.2021 17:25:06,366 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=931): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:06,366 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=186, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}
02.12.2021 17:25:06,375 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:06,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:06,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:06,427 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:06,428 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:06,428 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=851) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:06,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:06,450 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:06,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:06,476 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:06,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:06,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:06,528 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=851): org.apache.kafka.common.requests.HeartbeatResponse@106235c
02.12.2021 17:25:06,528 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:06,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 286
02.12.2021 17:25:06,551 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:06,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:06,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,560 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 421
02.12.2021 17:25:06,578 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:06,621 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:06,629 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:06,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 183
02.12.2021 17:25:06,656 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 90
02.12.2021 17:25:06,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 320
02.12.2021 17:25:06,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:06,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:06,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 85
02.12.2021 17:25:06,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,748 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,749 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 82
02.12.2021 17:25:06,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,750 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 231
02.12.2021 17:25:06,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 218
02.12.2021 17:25:06,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:06,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,777 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,818 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,819 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:06,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,834 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 127
02.12.2021 17:25:06,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 118
02.12.2021 17:25:06,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:06,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:06,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:06,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:06,942 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59693ms for 60000ms of delay, sleeping for 317ms
02.12.2021 17:25:06,954 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 27
02.12.2021 17:25:06,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 12
02.12.2021 17:25:06,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:06,981 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:06,983 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:06,984 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=637) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null}
02.12.2021 17:25:06,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 266
02.12.2021 17:25:06,986 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,986 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:06,987 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:06,987 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=637) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null}
02.12.2021 17:25:06,986 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,985 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=637): org.apache.kafka.common.requests.HeartbeatResponse@70cc954f
02.12.2021 17:25:06,989 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:06,987 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=637): org.apache.kafka.common.requests.HeartbeatResponse@58b767cd
02.12.2021 17:25:06,998 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:06,998 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 55 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce
02.12.2021 17:25:06,989 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 55 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477
02.12.2021 17:25:07,000 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:07,001 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:07,002 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -77, 64, -1, 56, 42, -109, 65, 2, -118, -121, -64, 38, -16, -85, 38, -9, 0, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:06,998 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:07,003 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:07,003 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -77, 64, -1, 56, 42, -109, 65, 2, -118, -121, -64, 38, -16, -85, 38, -9, 0, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:07,003 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=638) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:07,004 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 246
02.12.2021 17:25:07,003 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=638) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:07,005 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 57
02.12.2021 17:25:07,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 286
02.12.2021 17:25:07,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 286
02.12.2021 17:25:07,035 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:07,063 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119985ms for 120000ms of delay, sleeping for 25ms
02.12.2021 17:25:07,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:07,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,065 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,065 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,082 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 195
02.12.2021 17:25:07,084 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:07,087 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:07,090 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119070ms for 120000ms of delay, sleeping for 940ms
02.12.2021 17:25:07,132 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239128ms for 240000ms of delay, sleeping for 882ms
02.12.2021 17:25:07,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:07,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 185
02.12.2021 17:25:07,135 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:07,183 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:07,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 85
02.12.2021 17:25:07,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:07,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:07,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,250 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,251 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 10 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:07,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:07,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 0 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:07,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:07,260 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1129555, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:07,260 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1129565, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:07,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:07,260 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-4, new queue size is 10
02.12.2021 17:25:07,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,260 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:07,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:07,261 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59250ms for 60000ms of delay, sleeping for 760ms
02.12.2021 17:25:07,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,278 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:07,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,319 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,319 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,320 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,335 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:07,378 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:07,385 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:07,386 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:07,386 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1186) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null}
02.12.2021 17:25:07,420 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:07,420 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:07,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:07,479 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:07,486 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1186): org.apache.kafka.common.requests.HeartbeatResponse@3be1c116
02.12.2021 17:25:07,487 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:07,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:07,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:07,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:07,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 510 ms and fetched 0 records
02.12.2021 17:25:07,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,576 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,576 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:07,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:07,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:07,644 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 191
02.12.2021 17:25:07,681 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:07,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:07,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:07,745 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:07,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,753 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,753 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,782 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,782 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 355
02.12.2021 17:25:07,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,825 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,825 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,825 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,826 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,835 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,836 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 302
02.12.2021 17:25:07,883 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 254
02.12.2021 17:25:07,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:07,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:07,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 201
02.12.2021 17:25:07,985 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 152
02.12.2021 17:25:08,015 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239682ms for 240000ms of delay, sleeping for 328ms
02.12.2021 17:25:08,034 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59863ms for 60000ms of delay, sleeping for 147ms
02.12.2021 17:25:08,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 291
02.12.2021 17:25:08,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:08,046 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119691ms for 120000ms of delay, sleeping for 319ms
02.12.2021 17:25:08,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 89
02.12.2021 17:25:08,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,077 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,077 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,086 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 51
02.12.2021 17:25:08,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 181
02.12.2021 17:25:08,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 180
02.12.2021 17:25:08,146 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,146 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 186 and member id staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,146 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=644) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null}
02.12.2021 17:25:08,146 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,149 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,149 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,149 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,155 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 186 and member id staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,155 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=644) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null}
02.12.2021 17:25:08,149 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,147 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=644): org.apache.kafka.common.requests.HeartbeatResponse@4812dba9
02.12.2021 17:25:08,156 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=644): org.apache.kafka.common.requests.HeartbeatResponse@56b6b884
02.12.2021 17:25:08,156 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:08,156 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 186 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39
02.12.2021 17:25:08,156 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:08,156 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:08,156 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 78, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,156 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:08,159 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=645) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:08,159 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 186 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a
02.12.2021 17:25:08,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 177
02.12.2021 17:25:08,159 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:08,159 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:08,159 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 78, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,159 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=645) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:08,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 122
02.12.2021 17:25:08,189 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59493ms for 60000ms of delay, sleeping for 517ms
02.12.2021 17:25:08,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 81
02.12.2021 17:25:08,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 80
02.12.2021 17:25:08,247 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:08,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,254 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,254 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,256 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:08,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,283 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,284 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,326 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,326 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 19
02.12.2021 17:25:08,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:08,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,327 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,327 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 1
02.12.2021 17:25:08,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,329 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,329 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:08,329 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=629) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:08,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 498
02.12.2021 17:25:08,329 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=629): org.apache.kafka.common.requests.HeartbeatResponse@2673ae81
02.12.2021 17:25:08,329 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:08,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 498
02.12.2021 17:25:08,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 497
02.12.2021 17:25:08,337 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,337 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,337 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,337 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,337 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,337 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,337 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,337 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,337 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 10 records with 60 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:08,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 169069ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:08,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:08,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 61 iterations.
02.12.2021 17:25:08,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 61 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:08,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 169069ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:08,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:08,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:08,344 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:08,344 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:08,344 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:08,344 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -77, 64, -1, 56, 42, -109, 65, 2, -118, -121, -64, 38, -16, -85, 38, -9, 0, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 3])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:08,346 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1187) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:08,345 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,347 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:08,347 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=629) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:08,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,348 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 478
02.12.2021 17:25:08,347 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962155, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:08,349 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962165, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:08,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 5 ms and fetched 10 records
02.12.2021 17:25:08,348 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=629): org.apache.kafka.common.requests.HeartbeatResponse@7e915b8
02.12.2021 17:25:08,350 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:08,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 476
02.12.2021 17:25:08,351 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-3, new queue size is 10
02.12.2021 17:25:08,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,351 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:08,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 61 iterations.
02.12.2021 17:25:08,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 475
02.12.2021 17:25:08,358 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 236757ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:08,376 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119932ms for 120000ms of delay, sleeping for 78ms
02.12.2021 17:25:08,397 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:08,430 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:08,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 95 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:08,453 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 373
02.12.2021 17:25:08,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 43898ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:08,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:08,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 96 iterations.
02.12.2021 17:25:08,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 96 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:08,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 43898ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:08,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:08,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:08,461 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:08,461 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:08,461 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:08,461 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 78, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 6])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,461 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=932) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:08,461 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019404, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:08,462 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019414, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:08,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:08,463 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:08,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,463 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:08,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 96 iterations.
02.12.2021 17:25:08,465 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119349ms for 120000ms of delay, sleeping for 661ms
02.12.2021 17:25:08,470 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:08,530 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:08,560 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 266
02.12.2021 17:25:08,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 512 ms and fetched 0 records
02.12.2021 17:25:08,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,590 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,631 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:08,661 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 165
02.12.2021 17:25:08,708 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59872ms for 60000ms of delay, sleeping for 138ms
02.12.2021 17:25:08,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:08,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,756 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,756 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 65
02.12.2021 17:25:08,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,785 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,788 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:08,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:08,829 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,840 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,840 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,840 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:08,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,841 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,841 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,848 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59996ms for 60000ms of delay, sleeping for 14ms
02.12.2021 17:25:08,838 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:08,841 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:08,897 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59502ms for 60000ms of delay, sleeping for 508ms
02.12.2021 17:25:08,953 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 385
02.12.2021 17:25:08,956 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 385
02.12.2021 17:25:09,055 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 283
02.12.2021 17:25:09,057 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 284
02.12.2021 17:25:09,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,091 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,091 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,128 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119917ms for 120000ms of delay, sleeping for 93ms
02.12.2021 17:25:09,156 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 182
02.12.2021 17:25:09,157 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 184
02.12.2021 17:25:09,223 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119437ms for 120000ms of delay, sleeping for 573ms
02.12.2021 17:25:09,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 82
02.12.2021 17:25:09,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:09,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,258 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:09,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,291 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,358 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 237757ms delay out of 240000ms. Remaining 2243ms. Executor queue at 0
02.12.2021 17:25:09,364 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 237762ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:09,407 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58378ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:09,443 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:09,444 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:09,444 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:09,444 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=852) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:09,444 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:09,544 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:09,545 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=852): org.apache.kafka.common.requests.HeartbeatResponse@716d0f4
02.12.2021 17:25:09,545 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:09,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:09,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,602 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:09,645 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:09,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 82
02.12.2021 17:25:09,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 82
02.12.2021 17:25:09,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:09,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,765 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,793 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,793 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,807 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119720ms for 120000ms of delay, sleeping for 290ms
02.12.2021 17:25:09,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,843 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,843 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:09,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,849 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:09,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,849 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,866 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,945 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:09,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 380
02.12.2021 17:25:10,053 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 290
02.12.2021 17:25:10,070 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 279
02.12.2021 17:25:10,098 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119944ms for 120000ms of delay, sleeping for 66ms
02.12.2021 17:25:10,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,104 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,154 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:10,167 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119967ms for 120000ms of delay, sleeping for 43ms
02.12.2021 17:25:10,170 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 179
02.12.2021 17:25:10,211 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119410ms for 120000ms of delay, sleeping for 600ms
02.12.2021 17:25:10,254 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:10,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,266 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 78
02.12.2021 17:25:10,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:10,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,296 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,344 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:10,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,349 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,365 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 238763ms delay out of 240000ms. Remaining 1237ms. Executor queue at 1
02.12.2021 17:25:10,367 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238760ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:10,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,381 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,381 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,407 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59378ms delay out of 60000ms. Remaining 622ms. Executor queue at 2
02.12.2021 17:25:10,408 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59031ms for 60000ms of delay, sleeping for 979ms
02.12.2021 17:25:10,444 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:10,450 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:10,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:10,551 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:10,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:10,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,607 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,608 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,608 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:10,652 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:10,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:10,752 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:10,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:10,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,767 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,767 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:10,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,800 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,800 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,812 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119971ms for 120000ms of delay, sleeping for 39ms
02.12.2021 17:25:10,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,847 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 481
02.12.2021 17:25:10,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 96 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:10,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 46290ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:10,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:10,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 97 iterations.
02.12.2021 17:25:10,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 97 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:10,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:10,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,854 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 491
02.12.2021 17:25:10,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 46291ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:10,856 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:10,856 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:10,858 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019414, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:10,858 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019424, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:10,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:10,859 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:10,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,859 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:10,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 97 iterations.
02.12.2021 17:25:10,859 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119949ms for 120000ms of delay, sleeping for 61ms
02.12.2021 17:25:10,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:10,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,884 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,890 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,928 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119741ms for 120000ms of delay, sleeping for 269ms
02.12.2021 17:25:10,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 379
02.12.2021 17:25:10,954 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 391
02.12.2021 17:25:11,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 279
02.12.2021 17:25:11,055 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 290
02.12.2021 17:25:11,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,109 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,109 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,109 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,109 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,109 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,109 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,109 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,150 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 178
02.12.2021 17:25:11,156 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:11,198 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118930ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:11,250 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 78
02.12.2021 17:25:11,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:11,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,268 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,269 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:11,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,305 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,305 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,331 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:11,331 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:11,331 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=630) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:11,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 16
02.12.2021 17:25:11,331 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=630): org.apache.kafka.common.requests.HeartbeatResponse@55e2a555
02.12.2021 17:25:11,331 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:11,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 16
02.12.2021 17:25:11,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 16
02.12.2021 17:25:11,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,348 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,345 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:11,352 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:11,352 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=630) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:11,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 2
02.12.2021 17:25:11,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,354 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:11,354 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=630): org.apache.kafka.common.requests.HeartbeatResponse@4882b17d
02.12.2021 17:25:11,356 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:11,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:11,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,362 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:11,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:11,367 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239760ms delay out of 240000ms. Remaining 240ms. Executor queue at 2
02.12.2021 17:25:11,370 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239749ms for 240000ms of delay, sleeping for 261ms
02.12.2021 17:25:11,389 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59644ms for 60000ms of delay, sleeping for 366ms
02.12.2021 17:25:11,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:11,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,391 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,392 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,455 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:11,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:11,555 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:11,563 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:11,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,610 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,610 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,641 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239458ms for 240000ms of delay, sleeping for 552ms
02.12.2021 17:25:11,655 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:11,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:11,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 10 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:11,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:11,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 0 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:11,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:11,756 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:11,756 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1129565, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:11,756 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1129575, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:11,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:11,759 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-4, new queue size is 10
02.12.2021 17:25:11,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,759 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:11,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:11,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:11,769 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59665ms for 60000ms of delay, sleeping for 345ms
02.12.2021 17:25:11,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,772 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,806 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,812 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:11,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,854 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:11,863 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,867 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,869 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:11,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,903 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,903 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,962 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:11,977 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 392
02.12.2021 17:25:12,063 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:12,077 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:12,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,111 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,111 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,117 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59958ms for 60000ms of delay, sleeping for 52ms
02.12.2021 17:25:12,165 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:12,170 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59949ms for 60000ms of delay, sleeping for 61ms
02.12.2021 17:25:12,178 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:12,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 10 records with 61 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:12,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 172919ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:12,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:12,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 62 iterations.
02.12.2021 17:25:12,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 62 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:12,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 172919ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:12,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:12,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:12,195 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962165, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:12,195 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962175, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:12,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:12,195 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-3, new queue size is 10
02.12.2021 17:25:12,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,195 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:12,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 62 iterations.
02.12.2021 17:25:12,197 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239890ms for 240000ms of delay, sleeping for 120ms
02.12.2021 17:25:12,198 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119930ms delay out of 120000ms. Remaining 70ms. Executor queue at 0
02.12.2021 17:25:12,199 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119126ms for 120000ms of delay, sleeping for 884ms
02.12.2021 17:25:12,232 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59496ms for 60000ms of delay, sleeping for 514ms
02.12.2021 17:25:12,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:12,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,273 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:12,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:12,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,318 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,318 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,319 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239289ms for 240000ms of delay, sleeping for 721ms
02.12.2021 17:25:12,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:12,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,362 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:12,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,374 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,404 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:12,468 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:12,468 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:12,468 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=853) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:12,479 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 395
02.12.2021 17:25:12,563 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:12,569 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=853): org.apache.kafka.common.requests.HeartbeatResponse@268380d
02.12.2021 17:25:12,569 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:12,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:12,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,612 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,665 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:12,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:12,747 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59703ms for 60000ms of delay, sleeping for 307ms
02.12.2021 17:25:12,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:12,774 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:12,774 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,774 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,774 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,774 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,774 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,783 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:12,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,819 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,863 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,864 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,864 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,875 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,875 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,905 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,964 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:12,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:13,042 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239820ms for 240000ms of delay, sleeping for 190ms
02.12.2021 17:25:13,056 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59943ms for 60000ms of delay, sleeping for 67ms
02.12.2021 17:25:13,065 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:13,076 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:13,087 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119968ms for 120000ms of delay, sleeping for 42ms
02.12.2021 17:25:13,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,113 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,124 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59198ms for 60000ms of delay, sleeping for 812ms
02.12.2021 17:25:13,133 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119820ms for 120000ms of delay, sleeping for 190ms
02.12.2021 17:25:13,165 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:13,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:13,234 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239921ms for 240000ms of delay, sleeping for 89ms
02.12.2021 17:25:13,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:13,275 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,276 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,276 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:13,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,320 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:13,327 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119392ms for 120000ms of delay, sleeping for 618ms
02.12.2021 17:25:13,329 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239895ms for 240000ms of delay, sleeping for 115ms
02.12.2021 17:25:13,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,365 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,375 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:13,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,408 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,408 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,446 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239439ms for 240000ms of delay, sleeping for 571ms
02.12.2021 17:25:13,468 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:13,476 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:13,570 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:13,578 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:13,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,614 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:13,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:13,771 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:13,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,779 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:13,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,824 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,825 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,870 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:13,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,877 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 454
02.12.2021 17:25:13,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,881 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 463
02.12.2021 17:25:13,909 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,910 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,913 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,941 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59687ms for 60000ms of delay, sleeping for 323ms
02.12.2021 17:25:13,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 97 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:13,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 49407ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:13,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:13,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 98 iterations.
02.12.2021 17:25:13,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 98 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:13,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 49407ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:13,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:13,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:13,970 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019424, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:13,970 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019434, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:13,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:13,971 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:13,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,971 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:13,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 98 iterations.
02.12.2021 17:25:13,971 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119260ms for 120000ms of delay, sleeping for 750ms
02.12.2021 17:25:13,978 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 353
02.12.2021 17:25:13,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 363
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=645): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', members=[])
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', members=[])
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:14,008 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=187, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=187, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=187, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=645): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', members=[])
02.12.2021 17:25:14,014 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=646) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,014 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 311
02.12.2021 17:25:14,021 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239864ms for 240000ms of delay, sleeping for 146ms
02.12.2021 17:25:14,014 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', members=[])
02.12.2021 17:25:14,022 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:14,022 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=187, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}
02.12.2021 17:25:14,022 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=187, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=187, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,022 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=646) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 388
02.12.2021 17:25:14,078 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 253
02.12.2021 17:25:14,085 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 260
02.12.2021 17:25:14,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,115 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,116 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,140 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=646): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,140 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,140 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=187, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}
02.12.2021 17:25:14,140 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 187 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39
02.12.2021 17:25:14,140 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:14,140 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,141 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,140 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=646): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,141 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:14,141 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,141 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=187, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}
02.12.2021 17:25:14,141 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 187 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a
02.12.2021 17:25:14,141 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:14,141 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,141 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,141 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:14,141 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,141 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7] State transition from RUNNING to REBALANCING
02.12.2021 17:25:14,142 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:14,142 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 184
02.12.2021 17:25:14,141 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,142 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:14,142 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 273
02.12.2021 17:25:14,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 10 records with 62 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 174893ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:14,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:14,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 63 iterations.
02.12.2021 17:25:14,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 63 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 174893ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:14,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:14,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:14,169 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962175, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:14,169 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962185, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:14,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:14,170 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-3, new queue size is 10
02.12.2021 17:25:14,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,170 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:14,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 63 iterations.
02.12.2021 17:25:14,170 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239958ms for 240000ms of delay, sleeping for 52ms
02.12.2021 17:25:14,178 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 153
02.12.2021 17:25:14,186 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=638): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', members=[])
02.12.2021 17:25:14,186 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', members=[])
02.12.2021 17:25:14,186 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:14,186 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=638): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', members=[])
02.12.2021 17:25:14,186 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=56, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', protocol='stream'}
02.12.2021 17:25:14,186 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', members=[])
02.12.2021 17:25:14,186 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=56, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=56, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,186 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:14,187 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=56, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', protocol='stream'}
02.12.2021 17:25:14,187 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=56, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=56, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,187 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=639) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 429
02.12.2021 17:25:14,187 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=639) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:14,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 158
02.12.2021 17:25:14,223 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239400ms for 240000ms of delay, sleeping for 610ms
02.12.2021 17:25:14,229 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=639): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,229 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,229 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=56, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', protocol='stream'}
02.12.2021 17:25:14,229 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 56 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477
02.12.2021 17:25:14,229 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=639): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,229 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:14,230 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,230 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,230 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,230 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:14,230 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,230 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7] State transition from RUNNING to REBALANCING
02.12.2021 17:25:14,230 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:14,230 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=56, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', protocol='stream'}
02.12.2021 17:25:14,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 50
02.12.2021 17:25:14,230 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 56 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce
02.12.2021 17:25:14,231 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:14,231 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,231 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,231 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:14,231 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,231 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:14,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 387
02.12.2021 17:25:14,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 83
02.12.2021 17:25:14,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 170
02.12.2021 17:25:14,276 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59279ms for 60000ms of delay, sleeping for 731ms
02.12.2021 17:25:14,279 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 52
02.12.2021 17:25:14,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:14,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,281 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:14,281 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,281 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,281 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:14,281 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:14,281 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,281 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,281 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:14,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,281 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,282 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 58
02.12.2021 17:25:14,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,325 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:14,325 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,325 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,325 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:14,325 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:14,325 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,325 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,325 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:14,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,326 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,326 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 285
02.12.2021 17:25:14,331 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:14,338 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:14,338 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=631) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:14,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,338 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 39
02.12.2021 17:25:14,347 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:14,356 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:14,356 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=631) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:14,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,356 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 26
02.12.2021 17:25:14,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 70
02.12.2021 17:25:14,355 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=631): org.apache.kafka.common.requests.HeartbeatResponse@79b4cdad
02.12.2021 17:25:14,359 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:14,360 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=631): org.apache.kafka.common.requests.HeartbeatResponse@75596ae6
02.12.2021 17:25:14,366 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:14,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 18
02.12.2021 17:25:14,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 16
02.12.2021 17:25:14,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 15
02.12.2021 17:25:14,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 11
02.12.2021 17:25:14,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:14,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,381 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:14,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,384 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,385 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,385 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:14,385 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:14,426 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:14,427 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 517 ms and fetched 0 records
02.12.2021 17:25:14,427 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,427 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:14,427 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,427 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,427 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:14,427 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:14,428 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,428 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,428 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,428 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7] State transition from REBALANCING to RUNNING
02.12.2021 17:25:14,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:14,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,428 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,428 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 178
02.12.2021 17:25:14,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:14,484 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:14,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:14,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:14,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:14,539 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 77
02.12.2021 17:25:14,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:14,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:14,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:14,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:14,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,620 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:14,620 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,621 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,621 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:14,621 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:14,621 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,621 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,621 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,621 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7] State transition from REBALANCING to RUNNING
02.12.2021 17:25:14,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:14,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,622 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,622 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,627 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:14,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:14,686 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:14,687 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:14,686 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:14,723 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119833ms for 120000ms of delay, sleeping for 177ms
02.12.2021 17:25:14,723 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:14,728 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:14,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 195
02.12.2021 17:25:14,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,784 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,787 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:14,787 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:14,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,827 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,828 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 294
02.12.2021 17:25:14,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:14,837 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239644ms for 240000ms of delay, sleeping for 366ms
02.12.2021 17:25:14,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:14,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,886 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,884 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,892 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:14,889 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 395
02.12.2021 17:25:14,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,893 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:14,904 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119769ms for 120000ms of delay, sleeping for 241ms
02.12.2021 17:25:14,928 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:14,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,930 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 192
02.12.2021 17:25:14,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:14,993 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 291
02.12.2021 17:25:14,993 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:15,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 10 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:15,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:15,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 0 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:15,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:15,012 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1129575, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:15,012 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1129585, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:15,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:15,012 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-4, new queue size is 10
02.12.2021 17:25:15,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,013 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:15,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:15,013 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58878ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:15,028 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:15,030 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:15,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 90
02.12.2021 17:25:15,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:15,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 186
02.12.2021 17:25:15,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:15,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,123 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,128 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:15,130 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:15,149 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119964ms for 120000ms of delay, sleeping for 46ms
02.12.2021 17:25:15,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:15,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:15,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 86
02.12.2021 17:25:15,198 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119888ms for 120000ms of delay, sleeping for 122ms
02.12.2021 17:25:15,205 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239322ms for 240000ms of delay, sleeping for 688ms
02.12.2021 17:25:15,223 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:15,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:15,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:15,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,285 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,298 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:15,299 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:15,322 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119697ms for 120000ms of delay, sleeping for 313ms
02.12.2021 17:25:15,324 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:15,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,328 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:15,386 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:15,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,392 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30151ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:15,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,392 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:15,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,394 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30167ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:15,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,394 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,425 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:15,429 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:15,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:15,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,432 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,432 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,476 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:15,477 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:15,477 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=854) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:15,486 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:15,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:15,494 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:15,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:15,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:15,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:15,577 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=854): org.apache.kafka.common.requests.HeartbeatResponse@7e59adbf
02.12.2021 17:25:15,582 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:15,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:15,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:15,596 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:15,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,626 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,626 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,629 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:15,636 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119575ms for 120000ms of delay, sleeping for 435ms
02.12.2021 17:25:15,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:15,687 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:15,697 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:15,697 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:15,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:15,737 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:15,738 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 194
02.12.2021 17:25:15,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,785 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,785 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:15,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:15,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:15,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,828 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,828 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,839 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:15,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:15,898 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239959ms for 240000ms of delay, sleeping for 51ms
02.12.2021 17:25:15,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,899 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,899 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,900 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,932 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,932 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,932 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:15,928 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:15,950 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239911ms for 240000ms of delay, sleeping for 99ms
02.12.2021 17:25:15,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 294
02.12.2021 17:25:16,001 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:15,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:16,013 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59878ms delay out of 60000ms. Remaining 122ms. Executor queue at 0
02.12.2021 17:25:16,023 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 57959ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:16,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:16,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 90
02.12.2021 17:25:16,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:16,052 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239864ms for 240000ms of delay, sleeping for 146ms
02.12.2021 17:25:16,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 98 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:16,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 51510ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:16,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:16,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 99 iterations.
02.12.2021 17:25:16,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 99 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:16,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 51516ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:16,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:16,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:16,079 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=932): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', members=[])
02.12.2021 17:25:16,079 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', members=[])
02.12.2021 17:25:16,079 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:16,079 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=187, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}
02.12.2021 17:25:16,079 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=187, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=187, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:16,079 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019434, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:16,079 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019444, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:16,079 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=933) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:16,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:16,093 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:16,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,093 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:16,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 99 iterations.
02.12.2021 17:25:16,094 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 191
02.12.2021 17:25:16,098 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119904ms for 120000ms of delay, sleeping for 106ms
02.12.2021 17:25:16,106 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:16,107 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:16,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,129 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,130 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:16,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:16,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 190
02.12.2021 17:25:16,180 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=933): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:16,180 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=187, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}
02.12.2021 17:25:16,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:16,207 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119880ms for 120000ms of delay, sleeping for 130ms
02.12.2021 17:25:16,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:16,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:16,208 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239839ms for 240000ms of delay, sleeping for 171ms
02.12.2021 17:25:16,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:16,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 200
02.12.2021 17:25:16,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:16,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:16,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,292 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:16,308 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:16,308 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:16,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,329 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:16,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:16,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:16,345 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119914ms for 120000ms of delay, sleeping for 96ms
02.12.2021 17:25:16,382 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239325ms for 240000ms of delay, sleeping for 685ms
02.12.2021 17:25:16,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:16,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,400 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,400 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,400 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,431 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:16,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 191
02.12.2021 17:25:16,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:16,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,441 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,441 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:16,450 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119474ms for 120000ms of delay, sleeping for 536ms
02.12.2021 17:25:16,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 295
02.12.2021 17:25:16,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:16,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:16,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:16,540 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:16,541 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:16,597 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:16,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:16,601 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:16,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:16,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:16,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,636 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:16,642 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:16,697 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:16,702 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:16,703 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:16,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:16,738 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:16,743 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:16,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,793 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,794 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 392
02.12.2021 17:25:16,802 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:16,804 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:16,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:16,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,833 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 175
02.12.2021 17:25:16,839 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:16,844 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:16,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 291
02.12.2021 17:25:16,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:16,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,902 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,905 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 426
02.12.2021 17:25:16,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:16,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,905 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 428
02.12.2021 17:25:16,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 74
02.12.2021 17:25:16,939 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:16,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,943 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 79
02.12.2021 17:25:16,991 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118881ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:16,995 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 191
02.12.2021 17:25:17,005 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 326
02.12.2021 17:25:17,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:17,008 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,009 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 187 and member id staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:17,011 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=647) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null}
02.12.2021 17:25:17,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 325
02.12.2021 17:25:17,011 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=647): org.apache.kafka.common.requests.HeartbeatResponse@147c6062
02.12.2021 17:25:17,012 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,012 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 187 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a
02.12.2021 17:25:17,013 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:17,013 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:17,015 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 79, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:17,015 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=648) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,016 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 317
02.12.2021 17:25:17,020 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 327
02.12.2021 17:25:17,022 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,022 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 187 and member id staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:17,022 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=647) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null}
02.12.2021 17:25:17,023 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 421
02.12.2021 17:25:17,024 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=647): org.apache.kafka.common.requests.HeartbeatResponse@58cd98dc
02.12.2021 17:25:17,024 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,024 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 58960ms delay out of 60000ms. Remaining 1040ms. Executor queue at 0
02.12.2021 17:25:17,024 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58968ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:17,025 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 187 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39
02.12.2021 17:25:17,025 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:17,025 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:17,025 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 79, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:17,025 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=648) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 418
02.12.2021 17:25:17,040 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:17,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 10 records with 63 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:17,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 177794ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:17,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:17,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 64 iterations.
02.12.2021 17:25:17,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 64 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:17,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 177795ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:17,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:17,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:17,071 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1187): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', members=[])
02.12.2021 17:25:17,071 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', members=[])
02.12.2021 17:25:17,071 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:17,071 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=56, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', protocol='stream'}
02.12.2021 17:25:17,071 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=56, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=56, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:17,071 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962185, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:17,072 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962195, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:17,071 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1188) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null,assignments=[]}
02.12.2021 17:25:17,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:17,072 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-3, new queue size is 10
02.12.2021 17:25:17,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,073 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:17,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 64 iterations.
02.12.2021 17:25:17,074 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239453ms for 240000ms of delay, sleeping for 557ms
02.12.2021 17:25:17,096 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 90
02.12.2021 17:25:17,107 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 224
02.12.2021 17:25:17,111 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:17,120 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 227
02.12.2021 17:25:17,123 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:17,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,138 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 49
02.12.2021 17:25:17,172 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1188): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:17,172 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=56, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', protocol='stream'}
02.12.2021 17:25:17,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,186 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,186 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 56 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,186 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=640) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null}
02.12.2021 17:25:17,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 108
02.12.2021 17:25:17,187 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=640): org.apache.kafka.common.requests.HeartbeatResponse@489a9be6
02.12.2021 17:25:17,187 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,187 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 56 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477
02.12.2021 17:25:17,187 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:17,187 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:17,187 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -77, 64, -1, 56, 42, -109, 65, 2, -118, -121, -64, 38, -16, -85, 38, -9, 0, 0, 0, 0, 0, 0, 0, 0, 30, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,187 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=641) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 107
02.12.2021 17:25:17,187 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,188 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 56 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,188 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=640) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null}
02.12.2021 17:25:17,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 451
02.12.2021 17:25:17,188 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=640): org.apache.kafka.common.requests.HeartbeatResponse@5769f444
02.12.2021 17:25:17,188 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,188 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 56 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce
02.12.2021 17:25:17,188 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:17,188 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:17,188 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -77, 64, -1, 56, 42, -109, 65, 2, -118, -121, -64, 38, -16, -85, 38, -9, 0, 0, 0, 0, 0, 0, 0, 0, 30, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,188 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=641) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 449
02.12.2021 17:25:17,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 123
02.12.2021 17:25:17,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 127
02.12.2021 17:25:17,287 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:17,288 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:17,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,295 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,295 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,308 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 23
02.12.2021 17:25:17,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 26
02.12.2021 17:25:17,332 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,332 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:17,332 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=632) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:17,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 73
02.12.2021 17:25:17,333 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=632): org.apache.kafka.common.requests.HeartbeatResponse@6ec64e07
02.12.2021 17:25:17,333 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:17,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 72
02.12.2021 17:25:17,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,338 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,338 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 71
02.12.2021 17:25:17,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:17,347 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,347 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:17,347 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=632) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:17,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:17,348 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 71
02.12.2021 17:25:17,349 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=632): org.apache.kafka.common.requests.HeartbeatResponse@133bf45f
02.12.2021 17:25:17,351 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:17,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 68
02.12.2021 17:25:17,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 68
02.12.2021 17:25:17,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:17,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,411 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,411 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:17,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:17,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,423 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,423 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:17,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:17,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,445 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,446 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:17,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:17,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:17,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:17,632 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239874ms for 240000ms of delay, sleeping for 136ms
02.12.2021 17:25:17,645 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:17,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,650 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,650 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,713 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:17,725 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:17,779 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239614ms for 240000ms of delay, sleeping for 396ms
02.12.2021 17:25:17,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,796 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,804 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,814 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:17,825 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:17,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:17,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,841 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,841 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,912 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,912 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:17,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,929 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:17,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:17,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,949 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,962 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,992 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119882ms delay out of 120000ms. Remaining 118ms. Executor queue at 1
02.12.2021 17:25:17,992 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119520ms for 120000ms of delay, sleeping for 490ms
02.12.2021 17:25:18,014 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:18,025 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59969ms delay out of 60000ms. Remaining 31ms. Executor queue at 2
02.12.2021 17:25:18,030 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:18,038 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59296ms for 60000ms of delay, sleeping for 714ms
02.12.2021 17:25:18,115 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:18,137 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:18,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,151 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,151 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,178 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239027ms for 240000ms of delay, sleeping for 983ms
02.12.2021 17:25:18,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:18,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:18,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:18,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,307 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,307 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,315 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:18,338 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:18,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,343 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:18,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,413 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:18,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,431 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,431 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,465 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:18,465 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,466 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,484 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119459ms for 120000ms of delay, sleeping for 551ms
02.12.2021 17:25:18,491 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:18,491 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:18,491 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=855) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:18,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:18,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:18,591 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=855): org.apache.kafka.common.requests.HeartbeatResponse@4e756deb
02.12.2021 17:25:18,592 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:18,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:18,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:18,652 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,652 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,652 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,652 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,652 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,652 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,652 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,652 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30270ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:18,652 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:18,652 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,652 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,714 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:18,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:18,764 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59693ms for 60000ms of delay, sleeping for 317ms
02.12.2021 17:25:18,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,808 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30159ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:18,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:18,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,814 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:18,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:18,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:18,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,857 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,859 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,915 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,915 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:18,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,943 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,944 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:18,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,967 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,967 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,015 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:19,037 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119932ms for 120000ms of delay, sleeping for 78ms
02.12.2021 17:25:19,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:19,084 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59997ms for 60000ms of delay, sleeping for 13ms
02.12.2021 17:25:19,086 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:19,087 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 187 and member id staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:19,087 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=934) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null}
02.12.2021 17:25:19,099 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59862ms for 60000ms of delay, sleeping for 148ms
02.12.2021 17:25:19,116 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:19,117 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119977ms for 120000ms of delay, sleeping for 33ms
02.12.2021 17:25:19,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:19,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 99 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:19,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 54588ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:19,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:19,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 100 iterations.
02.12.2021 17:25:19,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 100 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:19,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 54589ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:19,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:19,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:19,151 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=934): org.apache.kafka.common.requests.HeartbeatResponse@797a4cf
02.12.2021 17:25:19,151 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:19,151 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:19,151 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:19,151 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:19,151 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 79, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 6])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:19,151 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=935) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:19,152 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019444, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:19,152 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019454, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:19,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:19,152 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:19,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,152 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:19,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 100 iterations.
02.12.2021 17:25:19,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,153 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30771ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:19,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:19,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,153 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,155 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119099ms for 120000ms of delay, sleeping for 911ms
02.12.2021 17:25:19,162 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239965ms for 240000ms of delay, sleeping for 45ms
02.12.2021 17:25:19,187 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:19,208 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239927ms for 240000ms of delay, sleeping for 83ms
02.12.2021 17:25:19,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:19,248 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59236ms for 60000ms of delay, sleeping for 774ms
02.12.2021 17:25:19,249 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:19,292 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239394ms for 240000ms of delay, sleeping for 616ms
02.12.2021 17:25:19,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,309 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30660ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:19,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:19,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,309 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:19,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:19,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,364 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,417 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,417 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:19,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,448 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,448 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,468 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,468 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:19,548 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:19,618 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:19,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:19,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,654 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31272ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:19,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:19,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,719 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:19,750 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:19,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,812 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31164ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:19,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:19,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,814 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:19,850 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:19,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:19,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,873 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,876 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 10 records with 64 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:19,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:19,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,921 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 410
02.12.2021 17:25:19,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 180638ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:19,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:19,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 65 iterations.
02.12.2021 17:25:19,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 65 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:19,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 180653ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:19,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:19,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:19,941 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:19,942 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:19,942 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:19,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,953 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,953 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 394
02.12.2021 17:25:19,942 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -77, 64, -1, 56, 42, -109, 65, 2, -118, -121, -64, 38, -16, -85, 38, -9, 0, 0, 0, 0, 0, 0, 0, 0, 30, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 3])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:19,954 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1189) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:19,956 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962195, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:19,962 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962205, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:19,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 21 ms and fetched 10 records
02.12.2021 17:25:19,963 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-3, new queue size is 10
02.12.2021 17:25:19,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,963 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:19,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 65 iterations.
02.12.2021 17:25:19,963 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 237856ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:19,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,971 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,979 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:20,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 10 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:20,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:20,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 0 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:20,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:20,023 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1129585, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:20,023 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1129595, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:20,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:20,024 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-4, new queue size is 10
02.12.2021 17:25:20,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,024 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:20,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:20,024 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59849ms for 60000ms of delay, sleeping for 161ms
02.12.2021 17:25:20,022 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 310
02.12.2021 17:25:20,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:20,068 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 117963ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:20,130 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 202
02.12.2021 17:25:20,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,154 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31772ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:20,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:20,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,155 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,154 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:20,186 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59502ms for 60000ms of delay, sleeping for 508ms
02.12.2021 17:25:20,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 102
02.12.2021 17:25:20,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:20,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:20,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,315 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31666ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:20,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:20,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,315 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 1
02.12.2021 17:25:20,332 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:20,332 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:20,332 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=633) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:20,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,333 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=633): org.apache.kafka.common.requests.HeartbeatResponse@557af2f8
02.12.2021 17:25:20,333 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:20,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:20,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:20,347 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:20,348 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:20,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,348 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=633) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:20,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 104
02.12.2021 17:25:20,350 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=633): org.apache.kafka.common.requests.HeartbeatResponse@5c306755
02.12.2021 17:25:20,350 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:20,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 103
02.12.2021 17:25:20,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 103
02.12.2021 17:25:20,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,377 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,423 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,423 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:20,451 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 3
02.12.2021 17:25:20,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,455 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,455 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:20,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:20,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,473 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,473 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:20,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:20,626 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:20,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,655 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32273ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:20,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:20,656 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,656 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,658 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:20,699 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59651ms for 60000ms of delay, sleeping for 359ms
02.12.2021 17:25:20,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:20,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:20,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,816 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32167ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:20,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:20,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,816 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:20,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:20,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,884 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,885 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,924 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:20,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,963 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,963 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:20,963 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 238856ms delay out of 240000ms. Remaining 1144ms. Executor queue at 0
02.12.2021 17:25:20,967 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238813ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:20,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:20,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,977 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,977 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:21,059 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59167ms for 60000ms of delay, sleeping for 843ms
02.12.2021 17:25:21,063 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:21,069 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 118964ms delay out of 120000ms. Remaining 1036ms. Executor queue at 1
02.12.2021 17:25:21,069 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118940ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:21,125 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:21,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,156 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32774ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:21,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:21,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,157 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,164 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:21,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:21,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:21,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,317 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32668ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:21,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:21,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,326 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:21,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:21,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:21,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,389 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,390 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,424 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,463 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,463 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:21,486 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,486 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,487 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,498 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:21,498 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:21,498 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=856) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:21,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:21,564 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:21,598 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=856): org.apache.kafka.common.requests.HeartbeatResponse@7fd595a1
02.12.2021 17:25:21,599 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:21,627 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:21,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,657 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Committing all active tasks [] and standby tasks [] since 33276ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:21,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:21,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,658 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:21,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:21,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:21,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,818 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Committing all active tasks [] and standby tasks [] since 33170ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:21,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:21,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:21,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:21,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,904 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59808ms for 60000ms of delay, sleeping for 202ms
02.12.2021 17:25:21,892 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,911 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,925 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,968 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239814ms delay out of 240000ms. Remaining 186ms. Executor queue at 2
02.12.2021 17:25:21,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:21,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,973 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,976 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239100ms for 240000ms of delay, sleeping for 910ms
02.12.2021 17:25:21,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:21,993 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,993 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,993 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,994 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,994 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,994 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,994 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,994 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,033 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=641): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', members=[])
02.12.2021 17:25:22,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:22,033 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=641): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', members=[])
02.12.2021 17:25:22,033 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', members=[])
02.12.2021 17:25:22,035 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:22,035 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=57, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', protocol='stream'}
02.12.2021 17:25:22,035 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=57, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=57, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,035 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', members=[])
02.12.2021 17:25:22,036 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:22,036 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=57, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', protocol='stream'}
02.12.2021 17:25:22,036 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=57, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=57, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,036 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=642) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,036 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=642) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 283
02.12.2021 17:25:22,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 122
02.12.2021 17:25:22,069 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119940ms delay out of 120000ms. Remaining 60ms. Executor queue at 3
02.12.2021 17:25:22,071 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119205ms for 120000ms of delay, sleeping for 805ms
02.12.2021 17:25:22,077 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:22,108 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59392ms for 60000ms of delay, sleeping for 618ms
02.12.2021 17:25:22,135 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:22,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,159 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Committing all active tasks [] and standby tasks [] since 33778ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:22,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:22,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,167 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=642): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,167 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,167 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=57, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', protocol='stream'}
02.12.2021 17:25:22,167 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 57 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477
02.12.2021 17:25:22,167 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:22,167 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,167 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,168 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:22,168 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,168 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7] State transition from RUNNING to REBALANCING
02.12.2021 17:25:22,168 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:22,168 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 152
02.12.2021 17:25:22,167 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=642): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,168 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,168 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=57, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', protocol='stream'}
02.12.2021 17:25:22,168 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 57 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce
02.12.2021 17:25:22,168 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:22,168 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,168 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,169 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:22,169 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,169 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:22,169 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 492
02.12.2021 17:25:22,177 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:22,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:22,268 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 51
02.12.2021 17:25:22,269 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 391
02.12.2021 17:25:22,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:22,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:22,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,319 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:22,319 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,319 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,319 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:22,320 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:22,320 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,320 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,320 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:22,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,320 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Committing all active tasks [] and standby tasks [] since 33671ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:22,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:22,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 290
02.12.2021 17:25:22,379 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:22,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,413 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,420 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:22,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:22,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,438 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,476 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 183
02.12.2021 17:25:22,494 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:22,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,495 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,496 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:22,525 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=648): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', members=[])
02.12.2021 17:25:22,526 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', members=[])
02.12.2021 17:25:22,526 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:22,526 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=188, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}
02.12.2021 17:25:22,526 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=648): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', members=[])
02.12.2021 17:25:22,526 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=188, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=188, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,527 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', members=[])
02.12.2021 17:25:22,529 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:22,528 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=649) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,530 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 383
02.12.2021 17:25:22,529 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=188, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}
02.12.2021 17:25:22,530 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=188, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=188, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,530 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=649) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,530 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 466
02.12.2021 17:25:22,539 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:22,564 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=649): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,564 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,564 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=188, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}
02.12.2021 17:25:22,564 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=649): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,564 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,564 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=188, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}
02.12.2021 17:25:22,564 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 188 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39
02.12.2021 17:25:22,564 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:22,564 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,565 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,564 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 188 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a
02.12.2021 17:25:22,565 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:22,565 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,565 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7] State transition from RUNNING to REBALANCING
02.12.2021 17:25:22,565 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:22,565 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:22,569 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,569 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 432
02.12.2021 17:25:22,569 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,572 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:22,573 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,573 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:22,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 349
02.12.2021 17:25:22,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:22,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 83
02.12.2021 17:25:22,621 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:22,642 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:22,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,661 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:22,662 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,662 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,662 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:22,662 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:22,662 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,662 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,662 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,662 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7] State transition from REBALANCING to RUNNING
02.12.2021 17:25:22,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:22,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,662 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Committing all active tasks [] and standby tasks [] since 34280ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:22,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 326
02.12.2021 17:25:22,673 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 240
02.12.2021 17:25:22,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:22,722 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:22,729 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59363ms for 60000ms of delay, sleeping for 647ms
02.12.2021 17:25:22,745 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:22,763 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:22,770 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 226
02.12.2021 17:25:22,774 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 139
02.12.2021 17:25:22,778 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:22,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,821 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,822 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,846 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:22,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:22,872 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 124
02.12.2021 17:25:22,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 36
02.12.2021 17:25:22,879 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:22,878 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119951ms for 120000ms of delay, sleeping for 59ms
02.12.2021 17:25:22,889 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239645ms for 240000ms of delay, sleeping for 365ms
02.12.2021 17:25:22,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,923 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:22,923 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,930 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:22,930 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:22,934 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:22,934 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,934 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,934 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:22,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,941 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,945 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,946 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119076ms for 120000ms of delay, sleeping for 934ms
02.12.2021 17:25:22,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:22,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,951 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,951 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 381
02.12.2021 17:25:22,965 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:22,974 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 22
02.12.2021 17:25:22,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:22,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,981 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 366
02.12.2021 17:25:22,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:23,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:23,002 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:23,002 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:23,013 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:23,013 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:23,015 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:23,021 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:23,028 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:23,028 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:23,030 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 292
02.12.2021 17:25:23,028 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7] State transition from REBALANCING to RUNNING
02.12.2021 17:25:23,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:23,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,034 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:23,051 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 281
02.12.2021 17:25:23,067 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:23,081 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 266
02.12.2021 17:25:23,131 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 191
02.12.2021 17:25:23,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:23,150 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 295
02.12.2021 17:25:23,152 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 180
02.12.2021 17:25:23,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,163 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,164 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,182 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 165
02.12.2021 17:25:23,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:23,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:23,250 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 195
02.12.2021 17:25:23,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 80
02.12.2021 17:25:23,257 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238466ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:23,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:23,282 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 65
02.12.2021 17:25:23,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,323 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,323 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,332 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:23,332 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:23,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,333 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=634) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:23,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 117
02.12.2021 17:25:23,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:23,334 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=634): org.apache.kafka.common.requests.HeartbeatResponse@15723d0f
02.12.2021 17:25:23,336 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:23,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 115
02.12.2021 17:25:23,337 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 114
02.12.2021 17:25:23,347 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:23,348 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:23,348 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=634) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:23,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,349 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 132
02.12.2021 17:25:23,350 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=634): org.apache.kafka.common.requests.HeartbeatResponse@1643cf7
02.12.2021 17:25:23,350 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:23,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 131
02.12.2021 17:25:23,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 131
02.12.2021 17:25:23,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:23,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:23,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 10 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:23,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:23,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 0 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:23,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:23,379 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1129595, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:23,379 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1129605, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:23,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:23,380 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-4, new queue size is 10
02.12.2021 17:25:23,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,380 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:23,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:23,381 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59303ms for 60000ms of delay, sleeping for 707ms
02.12.2021 17:25:23,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:23,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:23,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 13
02.12.2021 17:25:23,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:23,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,445 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,446 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,450 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 31
02.12.2021 17:25:23,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,452 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:23,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:23,481 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,481 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,481 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,481 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,481 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,481 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,482 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:23,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:23,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:23,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,539 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,539 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:23,553 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:23,568 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:23,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:23,625 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:23,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:23,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:23,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:23,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,664 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,665 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,665 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:23,728 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:23,740 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:23,748 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:23,755 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:23,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:23,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:23,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:23,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,829 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,830 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,840 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:23,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:23,856 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:23,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:23,887 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119947ms for 120000ms of delay, sleeping for 63ms
02.12.2021 17:25:23,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:23,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:23,940 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:23,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,947 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:23,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,958 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,959 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119825ms for 120000ms of delay, sleeping for 185ms
02.12.2021 17:25:23,958 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:23,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:23,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:23,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,990 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:24,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:24,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,048 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,048 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,061 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:24,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:24,077 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 88
02.12.2021 17:25:24,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:24,096 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58051ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:24,132 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:24,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 100 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:24,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 59583ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:24,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:24,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 101 iterations.
02.12.2021 17:25:24,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 101 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:24,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 59583ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:24,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:24,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:24,145 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=935): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', members=[])
02.12.2021 17:25:24,146 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', members=[])
02.12.2021 17:25:24,146 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:24,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:24,148 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=188, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}
02.12.2021 17:25:24,149 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=188, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=188, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:24,149 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019454, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:24,149 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019464, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:24,149 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=936) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:24,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 4 ms and fetched 10 records
02.12.2021 17:25:24,149 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:24,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,149 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:24,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 101 iterations.
02.12.2021 17:25:24,150 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119303ms for 120000ms of delay, sleeping for 707ms
02.12.2021 17:25:24,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,166 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:24,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 286
02.12.2021 17:25:24,174 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 284
02.12.2021 17:25:24,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:24,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:24,248 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:24,249 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=936): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:24,250 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=188, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}
02.12.2021 17:25:24,257 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239466ms delay out of 240000ms. Remaining 534ms. Executor queue at 0
02.12.2021 17:25:24,258 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239321ms for 240000ms of delay, sleeping for 689ms
02.12.2021 17:25:24,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:24,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 186
02.12.2021 17:25:24,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 184
02.12.2021 17:25:24,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:24,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:24,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,331 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:24,349 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:24,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:24,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 86
02.12.2021 17:25:24,375 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:24,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:24,432 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:24,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:24,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:24,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,460 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:24,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,460 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,460 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,469 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:24,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:24,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,495 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,495 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,504 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:24,504 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:24,504 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=857) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:24,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:24,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:24,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,549 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,560 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:24,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:24,570 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:24,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:24,604 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=857): org.apache.kafka.common.requests.HeartbeatResponse@3c3e7206
02.12.2021 17:25:24,604 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:24,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:24,650 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:24,661 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:24,662 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:24,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:24,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,666 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,666 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 369
02.12.2021 17:25:24,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:24,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:24,751 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:24,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:24,763 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:24,767 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 268
02.12.2021 17:25:24,799 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:24,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:24,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,850 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,850 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 186
02.12.2021 17:25:24,851 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:24,863 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:24,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:24,864 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119870ms for 120000ms of delay, sleeping for 140ms
02.12.2021 17:25:24,867 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 168
02.12.2021 17:25:24,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:24,950 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 86
02.12.2021 17:25:24,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:24,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,963 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,951 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:24,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,963 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239655ms for 240000ms of delay, sleeping for 355ms
02.12.2021 17:25:24,967 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 68
02.12.2021 17:25:24,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:24,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,978 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,978 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,964 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:24,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,005 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,005 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,006 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119886ms for 120000ms of delay, sleeping for 124ms
02.12.2021 17:25:25,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,036 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,037 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 57 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:25,037 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=643) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null}
02.12.2021 17:25:25,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 129
02.12.2021 17:25:25,040 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,041 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 57 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:25,041 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=643) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null}
02.12.2021 17:25:25,040 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,041 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 309
02.12.2021 17:25:25,039 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=643): org.apache.kafka.common.requests.HeartbeatResponse@7629aed7
02.12.2021 17:25:25,042 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,042 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=643): org.apache.kafka.common.requests.HeartbeatResponse@173eb1f5
02.12.2021 17:25:25,043 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,043 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 57 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce
02.12.2021 17:25:25,046 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:25,046 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:25,046 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -77, 64, -1, 56, 42, -109, 65, 2, -118, -121, -64, 38, -16, -85, 38, -9, 0, 0, 0, 0, 0, 0, 0, 0, 31, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:25,045 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 57 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477
02.12.2021 17:25:25,049 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:25,050 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:25,049 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=644) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,050 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -77, 64, -1, 56, 42, -109, 65, 2, -118, -121, -64, 38, -16, -85, 38, -9, 0, 0, 0, 0, 0, 0, 0, 0, 31, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:25,050 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 116
02.12.2021 17:25:25,050 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=644) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,053 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:25,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 513 ms and fetched 0 records
02.12.2021 17:25:25,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,068 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 461
02.12.2021 17:25:25,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:25,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 385
02.12.2021 17:25:25,096 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59051ms delay out of 60000ms. Remaining 949ms. Executor queue at 0
02.12.2021 17:25:25,105 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58965ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:25,105 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:25,131 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119608ms for 120000ms of delay, sleeping for 402ms
02.12.2021 17:25:25,137 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:25,141 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:25,168 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 361
02.12.2021 17:25:25,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:25,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,169 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,170 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,179 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:25,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 278
02.12.2021 17:25:25,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:25,269 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 260
02.12.2021 17:25:25,279 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:25,286 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 178
02.12.2021 17:25:25,306 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:25,320 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239184ms for 240000ms of delay, sleeping for 826ms
02.12.2021 17:25:25,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,351 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 160
02.12.2021 17:25:25,379 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:25,386 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 78
02.12.2021 17:25:25,406 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:25,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:25,469 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,469 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,469 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,470 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,470 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,470 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,470 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,473 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 56
02.12.2021 17:25:25,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,479 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,479 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 47
02.12.2021 17:25:25,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,506 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,527 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,527 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 188 and member id staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,527 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=650) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null}
02.12.2021 17:25:25,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 452
02.12.2021 17:25:25,527 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=650): org.apache.kafka.common.requests.HeartbeatResponse@539cc79c
02.12.2021 17:25:25,529 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,529 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 188 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a
02.12.2021 17:25:25,530 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:25,530 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:25,531 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 80, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,531 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=651) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 448
02.12.2021 17:25:25,531 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,531 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 188 and member id staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,531 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=650) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null}
02.12.2021 17:25:25,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,533 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=650): org.apache.kafka.common.requests.HeartbeatResponse@72bb67e4
02.12.2021 17:25:25,533 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,533 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 188 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39
02.12.2021 17:25:25,534 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:25,534 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:25,534 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 80, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,534 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=651) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 31
02.12.2021 17:25:25,540 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119651ms for 120000ms of delay, sleeping for 359ms
02.12.2021 17:25:25,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,570 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,570 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:25,570 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:25,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:25,627 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:25,632 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:25,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,671 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,671 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,671 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:25,707 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:25,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:25,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:25,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:25,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,866 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,873 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:25,902 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119972ms for 120000ms of delay, sleeping for 38ms
02.12.2021 17:25:25,909 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:25,941 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119988ms for 120000ms of delay, sleeping for 22ms
02.12.2021 17:25:25,970 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119765ms for 120000ms of delay, sleeping for 245ms
02.12.2021 17:25:25,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:25,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,980 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 352
02.12.2021 17:25:25,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,985 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,989 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 515 ms and fetched 0 records
02.12.2021 17:25:26,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,023 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 324
02.12.2021 17:25:26,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,072 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,080 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 252
02.12.2021 17:25:26,105 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59965ms delay out of 60000ms. Remaining 35ms. Executor queue at 0
02.12.2021 17:25:26,107 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58999ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:26,124 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 223
02.12.2021 17:25:26,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 10 records with 65 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:26,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 186873ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 66 iterations.
02.12.2021 17:25:26,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 66 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:26,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 186874ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:26,149 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1189): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', members=[])
02.12.2021 17:25:26,149 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', members=[])
02.12.2021 17:25:26,150 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:26,150 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=57, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', protocol='stream'}
02.12.2021 17:25:26,150 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=57, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=57, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:26,150 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962205, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:26,150 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962215, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:26,150 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1190) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null,assignments=[]}
02.12.2021 17:25:26,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:26,151 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-3, new queue size is 10
02.12.2021 17:25:26,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,151 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:26,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 66 iterations.
02.12.2021 17:25:26,151 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1190): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:26,151 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=57, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', protocol='stream'}
02.12.2021 17:25:26,154 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239816ms for 240000ms of delay, sleeping for 194ms
02.12.2021 17:25:26,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,172 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,172 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,181 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 151
02.12.2021 17:25:26,218 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119393ms for 120000ms of delay, sleeping for 617ms
02.12.2021 17:25:26,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 123
02.12.2021 17:25:26,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 51
02.12.2021 17:25:26,324 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 23
02.12.2021 17:25:26,333 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:26,333 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:26,334 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=635) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:26,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,334 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=635): org.apache.kafka.common.requests.HeartbeatResponse@4a7453a9
02.12.2021 17:25:26,335 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:26,337 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 145
02.12.2021 17:25:26,338 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 142
02.12.2021 17:25:26,348 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:26,352 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:26,352 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=635) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:26,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 171
02.12.2021 17:25:26,352 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=635): org.apache.kafka.common.requests.HeartbeatResponse@3fd46867
02.12.2021 17:25:26,352 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:26,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 171
02.12.2021 17:25:26,353 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 170
02.12.2021 17:25:26,354 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239715ms for 240000ms of delay, sleeping for 295ms
02.12.2021 17:25:26,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,367 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 41
02.12.2021 17:25:26,453 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 70
02.12.2021 17:25:26,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:26,481 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,481 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,481 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,481 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,481 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,481 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,481 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,481 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:26,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 517 ms and fetched 0 records
02.12.2021 17:25:26,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,506 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,524 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:26,578 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:26,578 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,580 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:26,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,626 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:26,664 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239779ms for 240000ms of delay, sleeping for 231ms
02.12.2021 17:25:26,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,675 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,675 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:26,728 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:26,785 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:26,828 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:26,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 101 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:26,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 62279ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 102 iterations.
02.12.2021 17:25:26,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 102 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:26,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 62287ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:26,850 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:26,851 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:26,851 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:26,854 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 80, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 6])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:26,862 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:26,862 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=937) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:26,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,868 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,865 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019464, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:26,871 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019474, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:26,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 21 ms and fetched 10 records
02.12.2021 17:25:26,871 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:26,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,871 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:26,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 102 iterations.
02.12.2021 17:25:26,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,884 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119051ms for 120000ms of delay, sleeping for 959ms
02.12.2021 17:25:26,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:26,904 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239977ms for 240000ms of delay, sleeping for 33ms
02.12.2021 17:25:26,928 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:26,944 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239777ms for 240000ms of delay, sleeping for 233ms
02.12.2021 17:25:26,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:26,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,991 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,007 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:27,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,031 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:27,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,083 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,083 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,091 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:27,111 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58141ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:27,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:27,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,176 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,180 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239004ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:27,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:27,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:27,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:27,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:27,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:27,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,375 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,392 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:27,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:27,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,492 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,492 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,511 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:27,511 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:27,511 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=858) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:27,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:27,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,514 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,532 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,585 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:27,611 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=858): org.apache.kafka.common.requests.HeartbeatResponse@f39046b
02.12.2021 17:25:27,613 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:27,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:27,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,677 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,677 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,692 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:27,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:27,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:27,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:27,844 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119846ms for 120000ms of delay, sleeping for 164ms
02.12.2021 17:25:27,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,881 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,881 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,898 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:27,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:27,994 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,018 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119796ms for 120000ms of delay, sleeping for 214ms
02.12.2021 17:25:28,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:28,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,025 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30299ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:28,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,032 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,086 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30306ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,086 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,105 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 394
02.12.2021 17:25:28,113 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59143ms delay out of 60000ms. Remaining 857ms. Executor queue at 0
02.12.2021 17:25:28,114 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59350ms for 60000ms of delay, sleeping for 660ms
02.12.2021 17:25:28,136 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:28,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,178 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,178 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,182 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239262ms for 240000ms of delay, sleeping for 748ms
02.12.2021 17:25:28,207 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:28,235 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119938ms for 120000ms of delay, sleeping for 72ms
02.12.2021 17:25:28,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:28,312 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119964ms for 120000ms of delay, sleeping for 46ms
02.12.2021 17:25:28,307 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:28,337 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:28,359 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119465ms for 120000ms of delay, sleeping for 545ms
02.12.2021 17:25:28,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,382 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:28,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:28,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:28,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,500 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,500 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,527 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30801ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:28,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,533 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,587 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30807ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,600 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:28,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 395
02.12.2021 17:25:28,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,683 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,701 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:28,739 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:28,783 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58629ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:28,805 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:28,840 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:28,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,883 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,907 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:28,918 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119746ms for 120000ms of delay, sleeping for 264ms
02.12.2021 17:25:28,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 10 records with 66 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:28,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 189661ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 67 iterations.
02.12.2021 17:25:28,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 67 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:28,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 189662ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:28,937 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:28,938 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:28,941 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:28,941 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -77, 64, -1, 56, 42, -109, 65, 2, -118, -121, -64, 38, -16, -85, 38, -9, 0, 0, 0, 0, 0, 0, 0, 0, 31, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 3])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:28,945 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1191) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:28,945 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:28,945 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962215, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:28,952 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962225, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:28,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 16 ms and fetched 10 records
02.12.2021 17:25:28,958 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-3, new queue size is 10
02.12.2021 17:25:28,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,958 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:28,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 67 iterations.
02.12.2021 17:25:28,959 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239673ms for 240000ms of delay, sleeping for 337ms
02.12.2021 17:25:28,957 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:29,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:29,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,007 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 326
02.12.2021 17:25:29,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,028 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31302ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,028 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:29,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,041 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,041 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 307
02.12.2021 17:25:29,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,088 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31308ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,108 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 225
02.12.2021 17:25:29,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 207
02.12.2021 17:25:29,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,185 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,185 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119851ms for 120000ms of delay, sleeping for 159ms
02.12.2021 17:25:29,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 125
02.12.2021 17:25:29,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 107
02.12.2021 17:25:29,297 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239969ms for 240000ms of delay, sleeping for 41ms
02.12.2021 17:25:29,309 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 24
02.12.2021 17:25:29,333 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:29,333 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:29,339 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=636) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:29,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,339 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=636): org.apache.kafka.common.requests.HeartbeatResponse@161e9a96
02.12.2021 17:25:29,339 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:29,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 168
02.12.2021 17:25:29,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 168
02.12.2021 17:25:29,342 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 6
02.12.2021 17:25:29,346 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238355ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:29,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 102 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:29,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 64785ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 103 iterations.
02.12.2021 17:25:29,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 103 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:29,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 64786ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:29,349 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019474, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:29,349 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019484, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:29,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:29,350 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:29,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,350 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:29,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 103 iterations.
02.12.2021 17:25:29,351 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118829ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:29,352 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:29,356 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:29,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,356 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=636) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:29,357 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 184
02.12.2021 17:25:29,359 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=636): org.apache.kafka.common.requests.HeartbeatResponse@7381eace
02.12.2021 17:25:29,360 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:29,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 181
02.12.2021 17:25:29,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 179
02.12.2021 17:25:29,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:29,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,389 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 68
02.12.2021 17:25:29,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 77
02.12.2021 17:25:29,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,508 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:29,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,532 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31806ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,542 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,543 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,548 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:29,556 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=651): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', members=[])
02.12.2021 17:25:29,556 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', members=[])
02.12.2021 17:25:29,556 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:29,556 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=189, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}
02.12.2021 17:25:29,556 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=189, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=189, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:29,557 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=652) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null,assignments=[]}
02.12.2021 17:25:29,557 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=651): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', members=[])
02.12.2021 17:25:29,557 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', members=[])
02.12.2021 17:25:29,557 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:29,557 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=189, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}
02.12.2021 17:25:29,557 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=189, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=189, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:29,557 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=652) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null,assignments=[]}
02.12.2021 17:25:29,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 31
02.12.2021 17:25:29,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 476
02.12.2021 17:25:29,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,589 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31809ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,610 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:29,617 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=652): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,617 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,617 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=189, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}
02.12.2021 17:25:29,617 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 189 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a
02.12.2021 17:25:29,617 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:29,617 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:29,617 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:29,617 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=652): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,618 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,618 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=189, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}
02.12.2021 17:25:29,618 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 189 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39
02.12.2021 17:25:29,618 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:29,618 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:29,618 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:29,618 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:29,618 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:29,618 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7] State transition from RUNNING to REBALANCING
02.12.2021 17:25:29,619 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:29,619 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 471
02.12.2021 17:25:29,618 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:29,621 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:29,621 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:29,621 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 416
02.12.2021 17:25:29,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:29,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,687 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,687 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,713 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:29,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 309
02.12.2021 17:25:29,719 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 370
02.12.2021 17:25:29,751 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:29,784 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59630ms delay out of 60000ms. Remaining 370ms. Executor queue at 0
02.12.2021 17:25:29,785 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58870ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:29,814 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:29,825 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 208
02.12.2021 17:25:29,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 263
02.12.2021 17:25:29,855 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:29,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,894 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,896 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,914 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:29,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 106
02.12.2021 17:25:29,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 161
02.12.2021 17:25:29,958 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:30,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,023 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,027 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 6
02.12.2021 17:25:30,023 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:30,042 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,042 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:30,035 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 54
02.12.2021 17:25:30,042 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,043 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,048 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,048 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,043 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:30,049 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:30,049 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,050 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,050 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:30,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,050 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32324ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:30,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,051 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:30,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,098 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:30,100 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,100 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,100 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:30,100 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:30,100 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,100 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,101 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,101 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7] State transition from REBALANCING to RUNNING
02.12.2021 17:25:30,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:30,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,101 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32321ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:30,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,102 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,132 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 391
02.12.2021 17:25:30,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:30,151 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:30,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:30,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,188 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,202 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:30,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 290
02.12.2021 17:25:30,249 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:30,251 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:30,258 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=644): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', members=[])
02.12.2021 17:25:30,258 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', members=[])
02.12.2021 17:25:30,258 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:30,258 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=58, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', protocol='stream'}
02.12.2021 17:25:30,258 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=58, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=58, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:30,258 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=645) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null,assignments=[]}
02.12.2021 17:25:30,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 430
02.12.2021 17:25:30,259 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=644): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', members=[])
02.12.2021 17:25:30,259 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', members=[])
02.12.2021 17:25:30,259 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:30,259 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=58, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', protocol='stream'}
02.12.2021 17:25:30,259 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=58, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=58, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:30,259 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=645) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null,assignments=[]}
02.12.2021 17:25:30,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 137
02.12.2021 17:25:30,297 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=645): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,297 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=645): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,297 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,297 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,297 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=58, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', protocol='stream'}
02.12.2021 17:25:30,297 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=58, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', protocol='stream'}
02.12.2021 17:25:30,297 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 58 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477
02.12.2021 17:25:30,297 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 58 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce
02.12.2021 17:25:30,297 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:30,297 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:30,297 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:30,298 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:30,298 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:30,298 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:30,298 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:30,298 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:30,298 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:30,298 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:30,298 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7] State transition from RUNNING to REBALANCING
02.12.2021 17:25:30,298 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:30,298 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:30,298 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 391
02.12.2021 17:25:30,298 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:30,302 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:30,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:30,348 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239357ms delay out of 240000ms. Remaining 643ms. Executor queue at 0
02.12.2021 17:25:30,348 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238333ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:30,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:30,352 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119830ms delay out of 120000ms. Remaining 170ms. Executor queue at 1
02.12.2021 17:25:30,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:30,369 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119252ms for 120000ms of delay, sleeping for 758ms
02.12.2021 17:25:30,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:30,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,398 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:30,398 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,398 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,398 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:30,398 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:30,398 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,398 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,398 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:30,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,398 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,398 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,399 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 289
02.12.2021 17:25:30,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:30,434 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:30,453 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:30,458 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:30,499 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:30,499 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 189
02.12.2021 17:25:30,503 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:30,517 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:30,519 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:30,520 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=859) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:30,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,524 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:30,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,552 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,553 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,551 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,554 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,599 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:30,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:30,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,604 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,601 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 88
02.12.2021 17:25:30,622 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=859): org.apache.kafka.common.requests.HeartbeatResponse@6a463a52
02.12.2021 17:25:30,622 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:30,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:30,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:30,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:30,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:30,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,694 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:30,694 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,694 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,694 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:30,694 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:30,694 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,694 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,694 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,694 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7] State transition from REBALANCING to RUNNING
02.12.2021 17:25:30,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:30,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,695 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,695 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,701 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:30,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:30,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:30,753 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:30,754 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:30,785 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59870ms delay out of 60000ms. Remaining 130ms. Executor queue at 1
02.12.2021 17:25:30,786 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 57807ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:30,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:30,801 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:30,805 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:30,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:30,857 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:30,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:30,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:30,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,906 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 200
02.12.2021 17:25:30,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,908 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,928 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:30,958 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:30,957 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:30,998 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:31,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:31,014 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 394
02.12.2021 17:25:31,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:31,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,044 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,044 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,059 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,060 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,060 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,060 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,060 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,060 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,060 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:31,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,061 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,061 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:31,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:31,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,111 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,112 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 294
02.12.2021 17:25:31,134 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119996ms for 120000ms of delay, sleeping for 14ms
02.12.2021 17:25:31,146 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:31,150 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119023ms for 120000ms of delay, sleeping for 987ms
02.12.2021 17:25:31,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:31,162 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:31,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,195 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,195 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,212 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:31,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 193
02.12.2021 17:25:31,247 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:31,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:31,262 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:31,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:31,312 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:31,315 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:31,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:31,348 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239333ms delay out of 240000ms. Remaining 667ms. Executor queue at 0
02.12.2021 17:25:31,355 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239250ms for 240000ms of delay, sleeping for 760ms
02.12.2021 17:25:31,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:31,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:31,396 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:31,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,409 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:31,448 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:31,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:31,471 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 89
02.12.2021 17:25:31,496 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:31,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:31,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:31,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,545 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,560 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,561 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,562 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,597 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:31,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:31,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:31,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,616 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,616 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,647 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:31,661 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:31,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:31,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,696 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,711 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:31,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:31,747 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:31,762 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:31,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:31,786 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 58807ms delay out of 60000ms. Remaining 1193ms. Executor queue at 1
02.12.2021 17:25:31,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 10 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:31,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 36815ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:31,793 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] task [0_4] Flushing record collector
02.12.2021 17:25:31,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] task [0_4] Prepared RUNNING task for committing
02.12.2021 17:25:31,794 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry1-4=OffsetAndMetadata{offset=1129605, leaderEpoch=null, metadata='AQAAAX179jXT'}} to coordinator kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:31,794 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=860) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry1,partitions=[{partition_index=4,committed_offset=1129605,committed_leader_epoch=-1,committed_metadata=AQAAAX179jXT}]}]}
02.12.2021 17:25:31,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:31,812 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:31,815 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received OFFSET_COMMIT response from node 2147483644 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=860): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry1', partitions=[OffsetCommitResponsePartition(partitionIndex=4, errorCode=0)])])
02.12.2021 17:25:31,817 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:31,816 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Committed offset 1129605 for partition redacted.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:31,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] task [0_4] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry1-4=1129604}
02.12.2021 17:25:31,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] task [0_4] Finalized commit for RUNNING task with eos false enforce checkpoint false
02.12.2021 17:25:31,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:684] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Committed all active tasks [0_4] and standby tasks [] in 0ms
02.12.2021 17:25:31,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 8 iterations.
02.12.2021 17:25:31,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 0 records with 8 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:31,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:31,821 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1129605, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:31,821 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1129615, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:31,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:31,822 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-4, new queue size is 10
02.12.2021 17:25:31,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,822 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:31,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 8 iterations.
02.12.2021 17:25:31,822 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58903ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:31,848 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:31,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:31,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:31,897 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:31,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,910 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,910 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,917 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:31,952 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:31,962 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:31,973 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:32,003 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 193
02.12.2021 17:25:32,010 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:32,017 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:32,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:32,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,054 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 279
02.12.2021 17:25:32,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,062 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,063 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 289
02.12.2021 17:25:32,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:32,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,070 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,081 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 475
02.12.2021 17:25:32,103 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:32,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:32,116 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239107ms for 240000ms of delay, sleeping for 903ms
02.12.2021 17:25:32,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:32,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,120 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,120 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 437
02.12.2021 17:25:32,141 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119720ms for 120000ms of delay, sleeping for 290ms
02.12.2021 17:25:32,156 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 177
02.12.2021 17:25:32,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:32,181 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 375
02.12.2021 17:25:32,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,197 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:32,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 337
02.12.2021 17:25:32,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 76
02.12.2021 17:25:32,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:32,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 275
02.12.2021 17:25:32,297 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:32,315 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:32,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 236
02.12.2021 17:25:32,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,333 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,337 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:32,349 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=637) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:32,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 221
02.12.2021 17:25:32,350 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=637): org.apache.kafka.common.requests.HeartbeatResponse@1471579f
02.12.2021 17:25:32,350 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:32,353 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,353 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:32,353 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=637) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:32,353 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 204
02.12.2021 17:25:32,354 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:32,353 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=637): org.apache.kafka.common.requests.HeartbeatResponse@2c542124
02.12.2021 17:25:32,354 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:32,355 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 209
02.12.2021 17:25:32,355 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 208
02.12.2021 17:25:32,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 174
02.12.2021 17:25:32,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:32,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,411 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,411 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,421 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 136
02.12.2021 17:25:32,433 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119333ms for 120000ms of delay, sleeping for 677ms
02.12.2021 17:25:32,454 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 100
02.12.2021 17:25:32,455 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 108
02.12.2021 17:25:32,482 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 74
02.12.2021 17:25:32,499 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:32,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:32,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 35
02.12.2021 17:25:32,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:32,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,556 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:32,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 7
02.12.2021 17:25:32,556 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,557 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 189 and member id staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,557 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=653) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null}
02.12.2021 17:25:32,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 24
02.12.2021 17:25:32,559 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,560 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 189 and member id staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,561 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=653) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null}
02.12.2021 17:25:32,559 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,561 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 59
02.12.2021 17:25:32,561 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=653): org.apache.kafka.common.requests.HeartbeatResponse@52141e
02.12.2021 17:25:32,561 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:32,561 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 189 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39
02.12.2021 17:25:32,561 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:32,561 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:32,561 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 81, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,561 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=654) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:32,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 58
02.12.2021 17:25:32,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:32,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,564 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,564 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:32,558 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=653): org.apache.kafka.common.requests.HeartbeatResponse@2623cdd0
02.12.2021 17:25:32,564 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:32,564 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 189 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a
02.12.2021 17:25:32,564 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:32,565 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:32,565 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 81, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,565 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=654) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:32,565 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 16
02.12.2021 17:25:32,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,582 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:32,601 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:32,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:32,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,620 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:32,656 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:32,657 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:32,661 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:32,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:32,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:32,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,699 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,700 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,714 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:32,757 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:32,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:32,801 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:32,814 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:32,829 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59910ms delay out of 60000ms. Remaining 90ms. Executor queue at 1
02.12.2021 17:25:32,830 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 57822ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:32,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:32,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:32,902 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:32,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:32,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,914 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 339
02.12.2021 17:25:32,967 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:32,965 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:33,002 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:33,021 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 238
02.12.2021 17:25:33,040 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239947ms for 240000ms of delay, sleeping for 63ms
02.12.2021 17:25:33,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,056 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,057 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:33,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,069 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,069 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:33,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,088 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,103 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:33,107 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239164ms for 240000ms of delay, sleeping for 846ms
02.12.2021 17:25:33,111 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119815ms for 120000ms of delay, sleeping for 195ms
02.12.2021 17:25:33,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,121 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,122 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 138
02.12.2021 17:25:33,157 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:33,169 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:33,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,200 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 58
02.12.2021 17:25:33,222 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 37
02.12.2021 17:25:33,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:33,259 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:33,259 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 58 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,259 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=646) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null}
02.12.2021 17:25:33,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 441
02.12.2021 17:25:33,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,259 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=646): org.apache.kafka.common.requests.HeartbeatResponse@504ee1de
02.12.2021 17:25:33,259 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:33,259 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 58 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce
02.12.2021 17:25:33,259 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:33,260 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:33,259 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:33,260 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 58 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,260 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -77, 64, -1, 56, 42, -109, 65, 2, -118, -121, -64, 38, -16, -85, 38, -9, 0, 0, 0, 0, 0, 0, 0, 0, 32, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,260 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=647) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:33,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 440
02.12.2021 17:25:33,260 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=646) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null}
02.12.2021 17:25:33,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 161
02.12.2021 17:25:33,261 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=646): org.apache.kafka.common.requests.HeartbeatResponse@16b46ffe
02.12.2021 17:25:33,261 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:33,261 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 58 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477
02.12.2021 17:25:33,262 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:33,262 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:33,262 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -77, 64, -1, 56, 42, -109, 65, 2, -118, -121, -64, 38, -16, -85, 38, -9, 0, 0, 0, 0, 0, 0, 0, 0, 32, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,262 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=647) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:33,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 157
02.12.2021 17:25:33,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:33,308 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119961ms for 120000ms of delay, sleeping for 49ms
02.12.2021 17:25:33,358 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:33,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 103 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:33,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 68803ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:33,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:33,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 104 iterations.
02.12.2021 17:25:33,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 104 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:33,361 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:33,361 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:33,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 68804ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:33,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:33,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:33,368 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=937): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', members=[])
02.12.2021 17:25:33,368 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', members=[])
02.12.2021 17:25:33,368 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:33,368 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=189, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}
02.12.2021 17:25:33,368 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=189, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=189, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:33,369 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=938) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:33,369 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019484, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:33,369 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019494, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:33,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:33,369 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:33,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,369 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:33,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 104 iterations.
02.12.2021 17:25:33,370 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119790ms for 120000ms of delay, sleeping for 220ms
02.12.2021 17:25:33,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:33,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:33,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,424 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:33,469 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=938): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:33,469 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=189, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}
02.12.2021 17:25:33,471 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:33,529 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:33,529 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:33,529 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=861) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:33,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,559 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,560 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,570 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,570 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,589 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,596 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119965ms for 120000ms of delay, sleeping for 45ms
02.12.2021 17:25:33,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:33,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,624 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,632 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=861): org.apache.kafka.common.requests.HeartbeatResponse@396dc226
02.12.2021 17:25:33,632 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:33,642 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118835ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:33,660 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:33,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:33,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,704 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:33,771 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:33,834 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 58826ms delay out of 60000ms. Remaining 1174ms. Executor queue at 0
02.12.2021 17:25:33,849 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59131ms for 60000ms of delay, sleeping for 879ms
02.12.2021 17:25:33,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:33,872 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:33,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:33,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,927 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:33,967 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239994ms for 240000ms of delay, sleeping for 16ms
02.12.2021 17:25:33,978 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:33,996 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239769ms for 240000ms of delay, sleeping for 241ms
02.12.2021 17:25:34,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:34,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,062 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,062 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,071 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:34,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,096 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,097 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:34,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,128 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,128 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:34,172 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:34,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:34,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,210 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,210 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 10 records with 67 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:34,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 194964ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:34,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:34,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 68 iterations.
02.12.2021 17:25:34,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 68 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:34,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 194964ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:34,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:34,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:34,239 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1191): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', members=[])
02.12.2021 17:25:34,239 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', members=[])
02.12.2021 17:25:34,239 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:34,239 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=58, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', protocol='stream'}
02.12.2021 17:25:34,239 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=58, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=58, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:34,240 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1192) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null,assignments=[]}
02.12.2021 17:25:34,240 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962225, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:34,240 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962235, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:34,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:34,240 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-3, new queue size is 10
02.12.2021 17:25:34,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,240 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:34,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 68 iterations.
02.12.2021 17:25:34,241 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239043ms for 240000ms of delay, sleeping for 967ms
02.12.2021 17:25:34,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:34,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:34,340 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1192): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:34,342 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=58, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', protocol='stream'}
02.12.2021 17:25:34,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:34,373 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:34,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,428 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,428 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,463 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:34,473 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:34,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,563 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,563 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,576 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,576 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,598 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,629 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,629 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,642 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119835ms delay out of 120000ms. Remaining 165ms. Executor queue at 1
02.12.2021 17:25:34,643 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119680ms for 120000ms of delay, sleeping for 330ms
02.12.2021 17:25:34,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:34,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:34,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,711 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,712 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:34,730 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59850ms for 60000ms of delay, sleeping for 160ms
02.12.2021 17:25:34,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:34,778 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:34,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:34,879 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:34,898 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59537ms for 60000ms of delay, sleeping for 473ms
02.12.2021 17:25:34,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,938 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,939 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:34,975 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119762ms for 120000ms of delay, sleeping for 248ms
02.12.2021 17:25:34,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:35,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,063 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,063 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 270
02.12.2021 17:25:35,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,076 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,076 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 277
02.12.2021 17:25:35,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,099 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,099 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,130 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,130 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 170
02.12.2021 17:25:35,177 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 176
02.12.2021 17:25:35,210 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239984ms for 240000ms of delay, sleeping for 26ms
02.12.2021 17:25:35,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,211 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,212 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:35,225 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119305ms for 120000ms of delay, sleeping for 705ms
02.12.2021 17:25:35,237 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239970ms for 240000ms of delay, sleeping for 40ms
02.12.2021 17:25:35,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 68
02.12.2021 17:25:35,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 76
02.12.2021 17:25:35,278 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239959ms for 240000ms of delay, sleeping for 51ms
02.12.2021 17:25:35,330 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239162ms for 240000ms of delay, sleeping for 848ms
02.12.2021 17:25:35,333 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:35,335 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:35,335 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=638) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:35,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,336 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=638): org.apache.kafka.common.requests.HeartbeatResponse@10ef8a5b
02.12.2021 17:25:35,338 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:35,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 225
02.12.2021 17:25:35,348 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 215
02.12.2021 17:25:35,354 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:35,362 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:35,362 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=638) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:35,353 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 214
02.12.2021 17:25:35,362 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=638): org.apache.kafka.common.requests.HeartbeatResponse@cf733dd
02.12.2021 17:25:35,363 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:35,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 213
02.12.2021 17:25:35,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 212
02.12.2021 17:25:35,384 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59354ms for 60000ms of delay, sleeping for 656ms
02.12.2021 17:25:35,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:35,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,441 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,441 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 106
02.12.2021 17:25:35,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 112
02.12.2021 17:25:35,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 6
02.12.2021 17:25:35,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,563 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,564 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:35,564 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 12
02.12.2021 17:25:35,577 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,577 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,577 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,577 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,577 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,577 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,577 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,577 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:35,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,604 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,604 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:35,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,634 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,635 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:35,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:35,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,716 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,717 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:35,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:35,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 187
02.12.2021 17:25:35,879 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:35,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 104 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:35,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 71369ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:35,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:35,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 105 iterations.
02.12.2021 17:25:35,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 105 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:35,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 71378ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:35,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:35,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:35,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:35,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,945 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,945 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,940 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:35,950 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:35,950 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:35,950 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 81, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 6])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:35,957 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=939) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:35,958 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=654): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', members=[])
02.12.2021 17:25:35,958 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', members=[])
02.12.2021 17:25:35,958 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:35,958 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=190, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}
02.12.2021 17:25:35,959 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=190, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=190, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:35,958 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=654): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', members=[])
02.12.2021 17:25:35,957 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019494, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:35,966 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019504, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:35,966 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=939): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', members=[])
02.12.2021 17:25:35,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 26 ms and fetched 10 records
02.12.2021 17:25:35,966 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:35,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,966 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:35,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 105 iterations.
02.12.2021 17:25:35,965 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', members=[])
02.12.2021 17:25:35,969 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:35,965 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=655) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null,assignments=[]}
02.12.2021 17:25:35,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 134
02.12.2021 17:25:35,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:35,969 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=190, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}
02.12.2021 17:25:35,979 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=190, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=190, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:35,979 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=655) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null,assignments=[]}
02.12.2021 17:25:35,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 155
02.12.2021 17:25:35,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:35,982 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119847ms for 120000ms of delay, sleeping for 163ms
02.12.2021 17:25:35,973 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:36,048 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59953ms for 60000ms of delay, sleeping for 57ms
02.12.2021 17:25:36,061 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=655): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:36,060 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=655): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:36,063 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:36,063 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=190, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}
02.12.2021 17:25:36,063 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 190 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39
02.12.2021 17:25:36,063 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:36,068 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:36,063 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:36,068 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=190, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}
02.12.2021 17:25:36,069 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 190 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a
02.12.2021 17:25:36,068 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:36,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,073 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,073 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,073 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:36,073 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:36,074 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:36,074 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:36,074 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:36,075 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:36,076 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:36,076 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7] State transition from RUNNING to REBALANCING
02.12.2021 17:25:36,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:36,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,079 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,079 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:36,079 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:36,080 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 41
02.12.2021 17:25:36,080 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,080 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 72
02.12.2021 17:25:36,109 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 8 records with 8 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,109 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:36,109 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 9 iterations.
02.12.2021 17:25:36,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 2 records with 9 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:36,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 10 iterations.
02.12.2021 17:25:36,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 0 records with 10 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:36,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:36,111 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1129615, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:36,111 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1129625, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:36,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:36,111 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-4, new queue size is 10
02.12.2021 17:25:36,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,111 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:36,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 10 iterations.
02.12.2021 17:25:36,117 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59158ms for 60000ms of delay, sleeping for 852ms
02.12.2021 17:25:36,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 518 ms and fetched 0 records
02.12.2021 17:25:36,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:36,122 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:36,122 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:36,123 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:36,123 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:36,123 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:36,123 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:36,123 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:36,123 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:36,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:36,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,123 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,124 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,146 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119808ms for 120000ms of delay, sleeping for 202ms
02.12.2021 17:25:36,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 518 ms and fetched 0 records
02.12.2021 17:25:36,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:36,155 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:36,156 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:36,156 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:36,156 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:36,156 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:36,156 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:36,156 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:36,156 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:36,156 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7] State transition from REBALANCING to RUNNING
02.12.2021 17:25:36,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:36,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,156 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,156 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,174 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:36,181 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239239ms for 240000ms of delay, sleeping for 771ms
02.12.2021 17:25:36,181 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:36,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,218 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:36,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:36,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:36,282 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:36,325 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:36,356 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119704ms for 120000ms of delay, sleeping for 306ms
02.12.2021 17:25:36,357 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:36,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:36,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:36,426 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:36,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,446 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,446 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,459 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:36,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:36,482 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:36,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:36,538 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:36,538 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:36,538 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=862) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:36,560 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:36,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,581 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,582 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,624 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,639 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=862): org.apache.kafka.common.requests.HeartbeatResponse@768c394f
02.12.2021 17:25:36,639 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:36,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,657 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,658 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,663 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119576ms for 120000ms of delay, sleeping for 434ms
02.12.2021 17:25:36,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:36,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:36,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:36,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,720 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,722 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,725 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:36,758 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:36,782 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:36,782 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:36,826 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:36,858 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:36,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:36,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:36,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:36,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,947 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,948 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,966 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239365ms for 240000ms of delay, sleeping for 645ms
02.12.2021 17:25:36,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:36,983 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:36,980 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59947ms for 60000ms of delay, sleeping for 63ms
02.12.2021 17:25:36,985 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:37,027 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:37,048 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59904ms for 60000ms of delay, sleeping for 106ms
02.12.2021 17:25:37,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 86
02.12.2021 17:25:37,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,082 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,082 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,082 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,082 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,098 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119999ms for 120000ms of delay, sleeping for 11ms
02.12.2021 17:25:37,112 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119900ms for 120000ms of delay, sleeping for 110ms
02.12.2021 17:25:37,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,125 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,125 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,155 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59100ms for 60000ms of delay, sleeping for 910ms
02.12.2021 17:25:37,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,159 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,183 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:37,183 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:37,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:37,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,223 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,223 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 105 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:37,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 72662ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:37,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:37,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 106 iterations.
02.12.2021 17:25:37,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 106 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:37,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 72662ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:37,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:37,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:37,225 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', members=[])
02.12.2021 17:25:37,225 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:37,225 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=190, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}
02.12.2021 17:25:37,225 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=190, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=190, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:37,225 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=940) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:37,225 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019504, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:37,225 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019514, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:37,225 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=940): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:37,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:37,226 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:37,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,226 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:37,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 106 iterations.
02.12.2021 17:25:37,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:37,226 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119680ms for 120000ms of delay, sleeping for 330ms
02.12.2021 17:25:37,254 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:37,254 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 58 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:37,254 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1193) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null}
02.12.2021 17:25:37,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:37,283 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:37,283 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:37,325 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=190, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}
02.12.2021 17:25:37,326 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:37,354 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1193): org.apache.kafka.common.requests.HeartbeatResponse@11604f53
02.12.2021 17:25:37,355 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:37,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:37,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:37,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:37,427 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:37,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,455 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,456 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,460 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:37,484 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:37,484 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:37,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:37,557 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119373ms for 120000ms of delay, sleeping for 637ms
02.12.2021 17:25:37,561 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:37,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,582 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,583 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 10 records with 68 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:37,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 198337ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:37,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:37,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 69 iterations.
02.12.2021 17:25:37,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 69 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:37,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 198338ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:37,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:37,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:37,615 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:37,616 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:37,616 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:37,617 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -77, 64, -1, 56, 42, -109, 65, 2, -118, -121, -64, 38, -16, -85, 38, -9, 0, 0, 0, 0, 0, 0, 0, 0, 32, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 3])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:37,619 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1194) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:37,619 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962235, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:37,619 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962245, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:37,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 6 ms and fetched 10 records
02.12.2021 17:25:37,620 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=647): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', members=[])
02.12.2021 17:25:37,620 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', members=[])
02.12.2021 17:25:37,620 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:37,620 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=59, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', protocol='stream'}
02.12.2021 17:25:37,620 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=59, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=59, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:37,621 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=648) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null,assignments=[]}
02.12.2021 17:25:37,623 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-3, new queue size is 10
02.12.2021 17:25:37,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,623 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:37,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 69 iterations.
02.12.2021 17:25:37,624 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239502ms for 240000ms of delay, sleeping for 508ms
02.12.2021 17:25:37,621 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 335
02.12.2021 17:25:37,620 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=647): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', members=[])
02.12.2021 17:25:37,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,630 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,628 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', members=[])
02.12.2021 17:25:37,633 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:37,633 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=59, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', protocol='stream'}
02.12.2021 17:25:37,635 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=59, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=59, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:37,639 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=648) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null,assignments=[]}
02.12.2021 17:25:37,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 83
02.12.2021 17:25:37,656 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:37,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,660 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,660 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:37,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:37,724 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,725 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,726 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:37,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:37,760 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:37,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:37,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:37,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:37,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:37,884 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:37,885 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:37,931 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:37,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:37,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,976 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,961 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:37,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:37,986 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:38,042 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 89
02.12.2021 17:25:38,078 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 82
02.12.2021 17:25:38,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:38,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,085 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,085 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 269
02.12.2021 17:25:38,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:38,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,086 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,086 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 247
02.12.2021 17:25:38,087 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59964ms for 60000ms of delay, sleeping for 46ms
02.12.2021 17:25:38,134 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59793ms for 60000ms of delay, sleeping for 217ms
02.12.2021 17:25:38,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:38,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,136 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,136 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239305ms for 240000ms of delay, sleeping for 705ms
02.12.2021 17:25:38,136 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:38,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,161 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,161 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:38,185 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 169
02.12.2021 17:25:38,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 147
02.12.2021 17:25:38,197 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119934ms for 120000ms of delay, sleeping for 76ms
02.12.2021 17:25:38,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:38,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,225 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:38,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:38,276 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119456ms for 120000ms of delay, sleeping for 554ms
02.12.2021 17:25:38,286 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 68
02.12.2021 17:25:38,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 46
02.12.2021 17:25:38,333 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:38,333 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:38,333 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=639) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:38,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,338 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:38,337 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=639): org.apache.kafka.common.requests.HeartbeatResponse@78ee7af4
02.12.2021 17:25:38,339 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:38,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 247
02.12.2021 17:25:38,354 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:38,354 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:38,354 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=639) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:38,354 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,354 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 231
02.12.2021 17:25:38,354 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 232
02.12.2021 17:25:38,360 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=639): org.apache.kafka.common.requests.HeartbeatResponse@107ce574
02.12.2021 17:25:38,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:38,360 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:38,366 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58303ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:38,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 225
02.12.2021 17:25:38,371 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 214
02.12.2021 17:25:38,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:38,460 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 126
02.12.2021 17:25:38,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:38,474 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 111
02.12.2021 17:25:38,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,477 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:38,565 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 21
02.12.2021 17:25:38,567 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:38,575 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 10
02.12.2021 17:25:38,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:38,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,587 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:38,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,587 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:38,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:38,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:38,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,637 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 321
02.12.2021 17:25:38,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:38,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,662 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 306
02.12.2021 17:25:38,688 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:38,688 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:38,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:38,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,727 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,738 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 220
02.12.2021 17:25:38,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 205
02.12.2021 17:25:38,789 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:38,789 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:38,843 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119743ms for 120000ms of delay, sleeping for 267ms
02.12.2021 17:25:38,841 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 117
02.12.2021 17:25:38,843 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239685ms for 240000ms of delay, sleeping for 325ms
02.12.2021 17:25:38,864 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 105
02.12.2021 17:25:38,890 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:38,890 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:38,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 15
02.12.2021 17:25:38,962 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:38,962 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:38,962 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:38,965 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 4
02.12.2021 17:25:38,965 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 190 and member id staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:38,966 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=656) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null}
02.12.2021 17:25:38,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 174
02.12.2021 17:25:38,966 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=656): org.apache.kafka.common.requests.HeartbeatResponse@7832952e
02.12.2021 17:25:38,967 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:38,967 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 190 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a
02.12.2021 17:25:38,967 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:38,967 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:38,967 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 82, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:38,967 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=657) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:38,967 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 170
02.12.2021 17:25:38,969 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:38,969 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:38,969 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:38,969 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:38,969 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:38,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:38,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:38,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:38,970 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:38,972 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 190 and member id staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:38,972 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=656) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null}
02.12.2021 17:25:38,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:38,972 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 191
02.12.2021 17:25:38,972 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=656): org.apache.kafka.common.requests.HeartbeatResponse@63c3fe08
02.12.2021 17:25:38,972 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:38,972 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 190 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39
02.12.2021 17:25:38,973 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:38,974 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:38,974 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 82, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:38,990 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:38,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,991 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,978 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=657) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:38,992 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 171
02.12.2021 17:25:38,993 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:39,066 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:39,072 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:39,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,088 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,089 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,089 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,112 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119001ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:39,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,138 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,163 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,176 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239991ms for 240000ms of delay, sleeping for 19ms
02.12.2021 17:25:39,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:39,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:39,196 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239990ms for 240000ms of delay, sleeping for 20ms
02.12.2021 17:25:39,217 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239515ms for 240000ms of delay, sleeping for 495ms
02.12.2021 17:25:39,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,228 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:39,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:39,366 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59303ms delay out of 60000ms. Remaining 697ms. Executor queue at 0
02.12.2021 17:25:39,373 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59254ms for 60000ms of delay, sleeping for 756ms
02.12.2021 17:25:39,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:39,390 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:39,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:39,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,495 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,495 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:39,543 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:39,543 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:39,543 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=863) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:39,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,589 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:39,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,595 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,639 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,639 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,639 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,644 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=863): org.apache.kafka.common.requests.HeartbeatResponse@31d161a9
02.12.2021 17:25:39,644 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:39,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,664 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,693 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:39,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:39,717 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239541ms for 240000ms of delay, sleeping for 469ms
02.12.2021 17:25:39,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,737 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,739 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:39,794 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:39,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:39,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:39,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,996 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:40,006 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:40,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:40,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,092 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,096 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,096 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,113 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119998ms for 120000ms of delay, sleeping for 12ms
02.12.2021 17:25:40,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 106 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:40,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 75564ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:40,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:40,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 107 iterations.
02.12.2021 17:25:40,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 107 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:40,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 75564ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:40,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:40,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:40,126 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:40,127 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:40,127 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:40,127 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 82, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 6])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:40,127 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=941) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:40,127 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019514, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:40,127 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019524, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:40,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:40,127 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:40,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,127 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:40,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 107 iterations.
02.12.2021 17:25:40,129 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119863ms for 120000ms of delay, sleeping for 147ms
02.12.2021 17:25:40,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 10 records with 10 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:40,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:40,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 0 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:40,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:40,131 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1129625, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:40,131 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1129635, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:40,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:40,131 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:40,131 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-4, new queue size is 10
02.12.2021 17:25:40,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,131 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:40,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:40,133 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59990ms for 60000ms of delay, sleeping for 20ms
02.12.2021 17:25:40,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,141 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,156 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59099ms for 60000ms of delay, sleeping for 911ms
02.12.2021 17:25:40,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,165 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,165 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,188 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239880ms for 240000ms of delay, sleeping for 130ms
02.12.2021 17:25:40,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:40,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:40,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:40,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,240 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 393
02.12.2021 17:25:40,278 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119688ms for 120000ms of delay, sleeping for 322ms
02.12.2021 17:25:40,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:40,297 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:40,319 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239013ms for 240000ms of delay, sleeping for 997ms
02.12.2021 17:25:40,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:40,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:40,494 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:40,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:40,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,498 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,498 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 122
02.12.2021 17:25:40,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,592 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,596 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,597 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,601 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119486ms for 120000ms of delay, sleeping for 524ms
02.12.2021 17:25:40,620 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:40,620 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:40,621 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=649) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null}
02.12.2021 17:25:40,621 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 377
02.12.2021 17:25:40,634 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:40,634 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:40,634 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=649) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null}
02.12.2021 17:25:40,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 104
02.12.2021 17:25:40,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,643 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,643 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,666 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,666 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,693 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:40,698 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:40,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,740 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,741 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:40,793 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:40,798 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:40,893 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:40,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:40,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:40,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:40,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,002 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,002 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,068 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59987ms for 60000ms of delay, sleeping for 23ms
02.12.2021 17:25:41,094 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59337ms for 60000ms of delay, sleeping for 673ms
02.12.2021 17:25:41,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:41,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,095 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,095 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 238
02.12.2021 17:25:41,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:41,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,100 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 254
02.12.2021 17:25:41,126 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119944ms for 120000ms of delay, sleeping for 66ms
02.12.2021 17:25:41,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,145 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,167 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,168 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,193 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119962ms for 120000ms of delay, sleeping for 48ms
02.12.2021 17:25:41,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 137
02.12.2021 17:25:41,201 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 153
02.12.2021 17:25:41,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,241 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,242 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119955ms for 120000ms of delay, sleeping for 55ms
02.12.2021 17:25:41,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 37
02.12.2021 17:25:41,298 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119224ms for 120000ms of delay, sleeping for 786ms
02.12.2021 17:25:41,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 53
02.12.2021 17:25:41,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 10 records with 69 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 202042ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:41,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:41,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 70 iterations.
02.12.2021 17:25:41,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 70 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 202042ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:41,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:41,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:41,318 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1194): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', members=[])
02.12.2021 17:25:41,318 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', members=[])
02.12.2021 17:25:41,318 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:41,318 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=59, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', protocol='stream'}
02.12.2021 17:25:41,318 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=59, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=59, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:41,318 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1195) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null,assignments=[]}
02.12.2021 17:25:41,318 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962245, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:41,319 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962255, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:41,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:41,319 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-3, new queue size is 10
02.12.2021 17:25:41,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,319 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:41,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 70 iterations.
02.12.2021 17:25:41,320 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239236ms for 240000ms of delay, sleeping for 774ms
02.12.2021 17:25:41,334 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:41,336 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:41,336 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=640) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:41,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 259
02.12.2021 17:25:41,336 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=640): org.apache.kafka.common.requests.HeartbeatResponse@1a468555
02.12.2021 17:25:41,336 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:41,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 259
02.12.2021 17:25:41,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 259
02.12.2021 17:25:41,348 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=657): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', members=[])
02.12.2021 17:25:41,352 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', members=[])
02.12.2021 17:25:41,348 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=657): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', members=[])
02.12.2021 17:25:41,352 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', members=[])
02.12.2021 17:25:41,359 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:41,352 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:41,359 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=191, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}
02.12.2021 17:25:41,359 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=191, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}
02.12.2021 17:25:41,355 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:41,355 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,361 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:41,359 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=191, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=191, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:41,359 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=191, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=191, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:41,365 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=658) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null,assignments=[]}
02.12.2021 17:25:41,362 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=640) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:41,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 239
02.12.2021 17:25:41,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 303
02.12.2021 17:25:41,365 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=658) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null,assignments=[]}
02.12.2021 17:25:41,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 280
02.12.2021 17:25:41,367 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=640): org.apache.kafka.common.requests.HeartbeatResponse@6cd7ba2f
02.12.2021 17:25:41,368 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:41,368 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 232
02.12.2021 17:25:41,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 231
02.12.2021 17:25:41,378 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=658): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,384 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,384 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=191, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}
02.12.2021 17:25:41,384 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 191 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39
02.12.2021 17:25:41,384 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:41,384 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,384 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,378 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=658): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,385 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:41,385 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,385 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7] State transition from RUNNING to REBALANCING
02.12.2021 17:25:41,385 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:41,385 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,385 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=191, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}
02.12.2021 17:25:41,385 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 284
02.12.2021 17:25:41,394 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 191 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a
02.12.2021 17:25:41,395 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:41,395 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,395 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,395 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:41,401 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,401 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:41,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 260
02.12.2021 17:25:41,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 158
02.12.2021 17:25:41,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 130
02.12.2021 17:25:41,494 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 174
02.12.2021 17:25:41,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,503 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,503 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 134
02.12.2021 17:25:41,540 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 56
02.12.2021 17:25:41,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 29
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 73
02.12.2021 17:25:41,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,596 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,596 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:41,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,603 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:41,612 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 33
02.12.2021 17:25:41,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:41,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,647 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:41,647 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,647 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,647 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:41,647 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:41,647 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:41,647 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:41,647 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:41,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:41,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,648 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,647 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=648): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,649 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,647 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=648): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,649 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,649 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=649): org.apache.kafka.common.requests.HeartbeatResponse@13c85a32
02.12.2021 17:25:41,649 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:41,651 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=59, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', protocol='stream'}
02.12.2021 17:25:41,651 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 59 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477
02.12.2021 17:25:41,651 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:41,651 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,651 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,651 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:41,651 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,651 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7] State transition from RUNNING to REBALANCING
02.12.2021 17:25:41,651 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:41,651 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 354
02.12.2021 17:25:41,649 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=649): org.apache.kafka.common.requests.HeartbeatResponse@60deacfb
02.12.2021 17:25:41,652 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:41,652 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=59, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', protocol='stream'}
02.12.2021 17:25:41,656 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 59 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce
02.12.2021 17:25:41,656 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:41,656 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,656 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,656 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:41,656 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,656 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:41,656 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:41,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,668 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:41,668 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,668 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,668 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:41,668 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:41,668 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:41,668 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:41,668 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:41,668 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7] State transition from REBALANCING to RUNNING
02.12.2021 17:25:41,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:41,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,668 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,669 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:41,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 394
02.12.2021 17:25:41,720 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1195): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 3, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,720 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 3, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,720 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=59, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', protocol='stream'}
02.12.2021 17:25:41,748 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:41,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:41,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,753 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:41,753 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,754 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,754 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:41,754 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:41,754 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:41,754 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:41,754 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:41,752 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 251
02.12.2021 17:25:41,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:41,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,755 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,756 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,768 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59946ms for 60000ms of delay, sleeping for 64ms
02.12.2021 17:25:41,769 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:41,796 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:41,812 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 291
02.12.2021 17:25:41,839 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59874ms for 60000ms of delay, sleeping for 136ms
02.12.2021 17:25:41,850 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:41,857 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:41,855 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 148
02.12.2021 17:25:41,872 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:41,898 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:41,912 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:41,950 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:41,957 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:41,958 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 45
02.12.2021 17:25:41,972 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:41,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 10 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:41,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 0 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:41,982 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1129635, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:41,982 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1129645, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:41,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:41,982 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-4, new queue size is 10
02.12.2021 17:25:41,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,982 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:41,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:41,983 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59933ms for 60000ms of delay, sleeping for 77ms
02.12.2021 17:25:42,000 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:42,003 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:42,003 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7] State transition from REBALANCING to RUNNING
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,004 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,013 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:42,053 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:42,058 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:42,066 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59024ms for 60000ms of delay, sleeping for 986ms
02.12.2021 17:25:42,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:42,095 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119941ms for 120000ms of delay, sleeping for 69ms
02.12.2021 17:25:42,098 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239987ms for 240000ms of delay, sleeping for 23ms
02.12.2021 17:25:42,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:42,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,104 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:42,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:42,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,107 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,107 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,125 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238966ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:42,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:42,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,156 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,156 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,161 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:42,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 107 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:42,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 77603ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:42,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:42,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 108 iterations.
02.12.2021 17:25:42,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 108 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:42,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 77603ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:42,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:42,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:42,165 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=941): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', members=[])
02.12.2021 17:25:42,165 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', members=[])
02.12.2021 17:25:42,165 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:42,165 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=191, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}
02.12.2021 17:25:42,165 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=191, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=191, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:42,165 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=942) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:42,165 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019524, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:42,166 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019534, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:42,166 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=942): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:42,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:42,167 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:42,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,167 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:42,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 108 iterations.
02.12.2021 17:25:42,169 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119824ms for 120000ms of delay, sleeping for 186ms
02.12.2021 17:25:42,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:42,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,177 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,177 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:42,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:42,216 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 391
02.12.2021 17:25:42,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:42,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,257 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,266 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=191, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}
02.12.2021 17:25:42,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:42,305 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:42,306 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:42,316 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 291
02.12.2021 17:25:42,356 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:42,358 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:42,364 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119715ms for 120000ms of delay, sleeping for 295ms
02.12.2021 17:25:42,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:42,405 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:42,406 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:42,416 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:42,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:42,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 293
02.12.2021 17:25:42,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:42,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:42,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,505 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:42,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:42,549 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:42,549 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:42,549 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=864) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:42,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:42,565 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 192
02.12.2021 17:25:42,578 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:42,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,605 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:42,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:42,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,610 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,650 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=864): org.apache.kafka.common.requests.HeartbeatResponse@6a9e496b
02.12.2021 17:25:42,651 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:42,656 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,657 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,657 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,661 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119039ms for 120000ms of delay, sleeping for 971ms
02.12.2021 17:25:42,665 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:42,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:42,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,679 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:42,706 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:42,711 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:42,757 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:42,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,758 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,785 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 397
02.12.2021 17:25:42,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:42,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:42,814 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:42,858 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:42,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 397
02.12.2021 17:25:42,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 295
02.12.2021 17:25:42,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:42,907 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:42,914 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:42,961 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:42,968 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 291
02.12.2021 17:25:42,988 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 194
02.12.2021 17:25:43,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:43,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,024 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,010 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:43,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:43,018 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:43,053 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59864ms for 60000ms of delay, sleeping for 146ms
02.12.2021 17:25:43,064 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:43,078 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 181
02.12.2021 17:25:43,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:43,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 515 ms and fetched 0 records
02.12.2021 17:25:43,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,120 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 510 ms and fetched 0 records
02.12.2021 17:25:43,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,121 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,122 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,125 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239966ms delay out of 240000ms. Remaining 34ms. Executor queue at 0
02.12.2021 17:25:43,126 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239729ms for 240000ms of delay, sleeping for 281ms
02.12.2021 17:25:43,126 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:43,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,158 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,158 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,178 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 81
02.12.2021 17:25:43,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:43,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,185 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,185 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,200 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59040ms for 60000ms of delay, sleeping for 970ms
02.12.2021 17:25:43,222 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:43,222 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:43,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:43,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:43,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,260 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 374
02.12.2021 17:25:43,286 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:43,322 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:43,322 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:43,326 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:43,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:43,360 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 274
02.12.2021 17:25:43,386 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:43,408 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239209ms for 240000ms of delay, sleeping for 801ms
02.12.2021 17:25:43,423 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:43,423 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:43,427 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:43,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 173
02.12.2021 17:25:43,460 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:43,486 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:43,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:43,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:43,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,528 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:43,528 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:43,561 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 73
02.12.2021 17:25:43,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:43,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:43,621 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:43,621 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,622 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=650) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null}
02.12.2021 17:25:43,622 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 407
02.12.2021 17:25:43,623 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=650): org.apache.kafka.common.requests.HeartbeatResponse@246e68a
02.12.2021 17:25:43,628 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:43,628 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 59 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477
02.12.2021 17:25:43,628 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:43,628 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:43,628 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -77, 64, -1, 56, 42, -109, 65, 2, -118, -121, -64, 38, -16, -85, 38, -9, 0, 0, 0, 0, 0, 0, 0, 0, 33, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,628 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=651) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:43,628 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:43,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,629 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,629 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:43,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,631 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,631 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,634 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119561ms for 120000ms of delay, sleeping for 449ms
02.12.2021 17:25:43,635 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:43,635 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,635 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=650) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null}
02.12.2021 17:25:43,635 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,635 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 125
02.12.2021 17:25:43,636 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=650): org.apache.kafka.common.requests.HeartbeatResponse@33a47d15
02.12.2021 17:25:43,636 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:43,636 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 59 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce
02.12.2021 17:25:43,637 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:43,638 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:43,638 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -77, 64, -1, 56, 42, -109, 65, 2, -118, -121, -64, 38, -16, -85, 38, -9, 0, 0, 0, 0, 0, 0, 0, 0, 33, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,638 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=651) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:43,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 121
02.12.2021 17:25:43,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,659 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,685 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,686 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,722 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:43,729 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:43,734 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:43,735 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:43,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:43,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,761 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,762 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:43,787 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:43,836 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:43,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:43,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:43,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:43,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:43,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:43,969 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 190
02.12.2021 17:25:43,989 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:44,029 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,029 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,029 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,029 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,029 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,029 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,029 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,029 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,029 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,038 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:44,041 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:44,069 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:44,092 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119203ms for 120000ms of delay, sleeping for 807ms
02.12.2021 17:25:44,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:44,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,130 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,131 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 203
02.12.2021 17:25:44,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,132 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,132 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 223
02.12.2021 17:25:44,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,159 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:44,172 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59264ms for 60000ms of delay, sleeping for 746ms
02.12.2021 17:25:44,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:44,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,190 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,191 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 168
02.12.2021 17:25:44,211 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239766ms for 240000ms of delay, sleeping for 244ms
02.12.2021 17:25:44,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 103
02.12.2021 17:25:44,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 123
02.12.2021 17:25:44,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:44,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,262 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,262 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 68
02.12.2021 17:25:44,324 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,324 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:44,324 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1196) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null}
02.12.2021 17:25:44,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 3
02.12.2021 17:25:44,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 23
02.12.2021 17:25:44,342 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,342 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,342 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:44,342 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=641) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:44,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 289
02.12.2021 17:25:44,348 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=641): org.apache.kafka.common.requests.HeartbeatResponse@415f42d
02.12.2021 17:25:44,348 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:44,348 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 283
02.12.2021 17:25:44,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 280
02.12.2021 17:25:44,360 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,360 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 191 and member id staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,360 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=659) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null}
02.12.2021 17:25:44,360 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,359 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,360 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=659): org.apache.kafka.common.requests.HeartbeatResponse@577c91d4
02.12.2021 17:25:44,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,361 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:44,360 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 191 and member id staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,362 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=659) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null}
02.12.2021 17:25:44,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:44,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,362 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=659): org.apache.kafka.common.requests.HeartbeatResponse@fba853a
02.12.2021 17:25:44,362 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 191 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39
02.12.2021 17:25:44,363 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:44,363 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:44,363 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,364 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:44,364 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=641) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:44,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 268
02.12.2021 17:25:44,364 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 191 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a
02.12.2021 17:25:44,364 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:44,364 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:44,363 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:44,365 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=641): org.apache.kafka.common.requests.HeartbeatResponse@6187fb90
02.12.2021 17:25:44,365 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:44,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 267
02.12.2021 17:25:44,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 266
02.12.2021 17:25:44,365 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 83, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,365 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 83, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,366 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=660) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:44,366 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=660) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:44,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 293
02.12.2021 17:25:44,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 324
02.12.2021 17:25:44,425 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1196): org.apache.kafka.common.requests.HeartbeatResponse@17b71f2
02.12.2021 17:25:44,425 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:44,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 179
02.12.2021 17:25:44,456 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239822ms for 240000ms of delay, sleeping for 188ms
02.12.2021 17:25:44,460 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:44,462 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:44,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 166
02.12.2021 17:25:44,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,530 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,530 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,553 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 78
02.12.2021 17:25:44,569 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 63
02.12.2021 17:25:44,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,632 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,632 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:44,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,633 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:44,645 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238755ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:44,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,660 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,661 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:44,692 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:44,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,694 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,694 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:44,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:44,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:44,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:44,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,765 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:44,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:44,905 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119987ms for 120000ms of delay, sleeping for 23ms
02.12.2021 17:25:44,923 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59807ms for 60000ms of delay, sleeping for 203ms
02.12.2021 17:25:44,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:44,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:44,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 108 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:44,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 80375ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 109 iterations.
02.12.2021 17:25:44,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 109 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:44,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 80376ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:44,938 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:44,939 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:44,939 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:44,944 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 83, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 6])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,945 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=943) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:44,945 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019534, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:44,945 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019544, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:44,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 7 ms and fetched 10 records
02.12.2021 17:25:44,946 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:44,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,946 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:44,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 109 iterations.
02.12.2021 17:25:44,951 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119788ms for 120000ms of delay, sleeping for 222ms
02.12.2021 17:25:44,969 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:45,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,032 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:45,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:45,127 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59275ms for 60000ms of delay, sleeping for 735ms
02.12.2021 17:25:45,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,133 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,134 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,161 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,161 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,175 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119021ms for 120000ms of delay, sleeping for 989ms
02.12.2021 17:25:45,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,195 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,195 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:45,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:45,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,266 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:45,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:45,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:45,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:45,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:45,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:45,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,541 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,542 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,542 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:45,569 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:45,569 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:45,569 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=865) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:45,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:45,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,635 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30243ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,639 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:45,639 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,640 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30246ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,646 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239756ms delay out of 240000ms. Remaining 244ms. Executor queue at 0
02.12.2021 17:25:45,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 10 records with 70 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:45,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 206373ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 71 iterations.
02.12.2021 17:25:45,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 71 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:45,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 206373ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:45,648 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 59 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c
02.12.2021 17:25:45,648 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:45,649 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[redacted.Cloud.Message.Callback.Retry3-3], userDataSize=48)
02.12.2021 17:25:45,649 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:45,649 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:330] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Skip resuming since state is RUNNING
02.12.2021 17:25:45,650 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:45,651 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:45,651 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7] State transition from RUNNING to REBALANCING
02.12.2021 17:25:45,651 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Pausing partitions [redacted.Cloud.Message.Callback.Retry3-3]
02.12.2021 17:25:45,651 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 59 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c
02.12.2021 17:25:45,651 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:45,651 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:45,651 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -77, 64, -1, 56, 42, -109, 65, 2, -118, -121, -64, 38, -16, -85, 38, -9, 0, 0, 0, 0, 0, 0, 0, 0, 33, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 3])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:45,651 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1197) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:45,652 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-3 because it is paused
02.12.2021 17:25:45,652 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 496
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,662 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,669 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=865): org.apache.kafka.common.requests.HeartbeatResponse@3d35caec
02.12.2021 17:25:45,670 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:45,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,696 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,736 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:45,739 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:45,741 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:45,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,767 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,767 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,770 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1197): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', members=[])
02.12.2021 17:25:45,770 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=651): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', members=[])
02.12.2021 17:25:45,770 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=651): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', members=[])
02.12.2021 17:25:45,770 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', members=[])
02.12.2021 17:25:45,770 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', members=[])
02.12.2021 17:25:45,771 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:45,770 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:45,771 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=60, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', protocol='stream'}
02.12.2021 17:25:45,770 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', members=[])
02.12.2021 17:25:45,771 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:45,771 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=60, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', protocol='stream'}
02.12.2021 17:25:45,771 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=60, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=60, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:45,771 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=60, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', protocol='stream'}
02.12.2021 17:25:45,771 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=652) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null,assignments=[]}
02.12.2021 17:25:45,771 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=60, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=60, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:45,771 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=60, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=60, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:45,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 271
02.12.2021 17:25:45,772 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1198) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null,assignments=[]}
02.12.2021 17:25:45,772 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=652) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null,assignments=[]}
02.12.2021 17:25:45,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 495
02.12.2021 17:25:45,772 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-3 because it is paused
02.12.2021 17:25:45,773 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-3 because it is paused
02.12.2021 17:25:45,774 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 375
02.12.2021 17:25:45,841 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:45,839 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:45,872 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59824ms for 60000ms of delay, sleeping for 186ms
02.12.2021 17:25:45,941 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:45,948 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:46,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:46,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,048 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,048 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:46,052 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:46,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 10 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:46,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:46,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 0 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:46,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:46,079 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1129645, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:46,079 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1129655, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:46,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Main Consumer poll completed in 11 ms and fetched 10 records
02.12.2021 17:25:46,080 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-4, new queue size is 10
02.12.2021 17:25:46,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,080 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:46,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:46,080 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59326ms for 60000ms of delay, sleeping for 684ms
02.12.2021 17:25:46,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:46,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,142 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,142 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:46,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,142 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,143 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,149 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-3 because it is paused
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Resuming partitions [redacted.Cloud.Message.Callback.Retry3-3]
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:46,150 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:46,150 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7] State transition from REBALANCING to RUNNING
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 71 iterations.
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 71 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 206875ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:46,150 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962255, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:46,150 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962265, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:46,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:46,151 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-3, new queue size is 10
02.12.2021 17:25:46,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,151 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:46,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 71 iterations.
02.12.2021 17:25:46,152 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239992ms for 240000ms of delay, sleeping for 18ms
02.12.2021 17:25:46,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,163 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,165 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119261ms for 120000ms of delay, sleeping for 749ms
02.12.2021 17:25:46,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,167 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,171 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239288ms for 240000ms of delay, sleeping for 722ms
02.12.2021 17:25:46,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:46,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,198 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:46,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:46,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,268 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,269 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,342 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:46,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:46,443 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:46,448 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:46,543 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:46,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:46,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:46,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,550 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,643 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:46,643 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,645 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,646 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,646 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,646 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,646 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,646 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,646 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,668 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,668 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:46,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,699 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,699 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:46,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:46,765 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59007ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:46,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,770 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,770 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,846 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:46,846 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:46,904 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239955ms for 240000ms of delay, sleeping for 55ms
02.12.2021 17:25:46,918 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119574ms for 120000ms of delay, sleeping for 436ms
02.12.2021 17:25:46,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:46,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:46,962 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239764ms for 240000ms of delay, sleeping for 246ms
02.12.2021 17:25:47,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:47,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,051 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,051 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,056 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:47,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,144 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,144 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:47,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,147 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 216
02.12.2021 17:25:47,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,169 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,169 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,200 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,210 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239810ms for 240000ms of delay, sleeping for 200ms
02.12.2021 17:25:47,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:47,247 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 116
02.12.2021 17:25:47,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,271 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,319 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=652): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,319 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,319 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=60, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477', protocol='stream'}
02.12.2021 17:25:47,319 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=652): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,319 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,319 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=60, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce', protocol='stream'}
02.12.2021 17:25:47,319 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 60 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477
02.12.2021 17:25:47,320 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 60 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce
02.12.2021 17:25:47,320 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:47,320 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:47,320 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:47,320 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:47,320 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:47,320 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:47,320 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:47,320 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:47,320 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:47,320 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:47,320 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7] State transition from RUNNING to REBALANCING
02.12.2021 17:25:47,320 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:47,320 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:47,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 232
02.12.2021 17:25:47,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 452
02.12.2021 17:25:47,343 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:47,343 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:47,343 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=642) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:47,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:47,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 301
02.12.2021 17:25:47,343 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=642): org.apache.kafka.common.requests.HeartbeatResponse@68c41ba6
02.12.2021 17:25:47,343 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:47,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 301
02.12.2021 17:25:47,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 301
02.12.2021 17:25:47,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 16
02.12.2021 17:25:47,351 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1198): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 3, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,352 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 3, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,352 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=60, memberId='staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c', protocol='stream'}
02.12.2021 17:25:47,355 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119942ms for 120000ms of delay, sleeping for 68ms
02.12.2021 17:25:47,363 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:47,364 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:47,364 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=642) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:47,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:47,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 283
02.12.2021 17:25:47,365 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=642): org.apache.kafka.common.requests.HeartbeatResponse@54db55a6
02.12.2021 17:25:47,365 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:47,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 282
02.12.2021 17:25:47,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 282
02.12.2021 17:25:47,411 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239499ms for 240000ms of delay, sleeping for 511ms
02.12.2021 17:25:47,421 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 130
02.12.2021 17:25:47,421 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 350
02.12.2021 17:25:47,424 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119538ms for 120000ms of delay, sleeping for 472ms
02.12.2021 17:25:47,444 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:47,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 181
02.12.2021 17:25:47,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 30
02.12.2021 17:25:47,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 250
02.12.2021 17:25:47,544 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 100
02.12.2021 17:25:47,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:47,553 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:47,553 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:47,555 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:47,555 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:47,555 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:47,555 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:47,555 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:47,555 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:47,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:47,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,558 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,567 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 80
02.12.2021 17:25:47,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 148
02.12.2021 17:25:47,645 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,645 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,645 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,645 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,645 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,645 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,645 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,645 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:47,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,647 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,647 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:47,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:47,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,670 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:47,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,710 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,710 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,723 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 48
02.12.2021 17:25:47,748 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:47,748 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:47,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:47,768 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59851ms for 60000ms of delay, sleeping for 159ms
02.12.2021 17:25:47,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:47,775 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:47,777 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:47,777 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:47,781 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:47,782 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:47,785 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:47,790 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:47,790 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:47,790 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7] State transition from REBALANCING to RUNNING
02.12.2021 17:25:47,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:47,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,792 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,792 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,853 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:47,853 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:47,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:47,893 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:47,897 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119774ms for 120000ms of delay, sleeping for 236ms
02.12.2021 17:25:47,926 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239919ms for 240000ms of delay, sleeping for 91ms
02.12.2021 17:25:47,928 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 57942ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:47,964 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:47,957 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:47,954 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:47,994 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:48,040 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238900ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:48,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,059 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:48,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 79
02.12.2021 17:25:48,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 77
02.12.2021 17:25:48,099 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 193
02.12.2021 17:25:48,135 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119824ms for 120000ms of delay, sleeping for 186ms
02.12.2021 17:25:48,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:48,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,152 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,152 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:48,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,159 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:48,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,171 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,207 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 85
02.12.2021 17:25:48,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,211 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,211 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,253 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:48,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:48,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:48,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,292 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 478
02.12.2021 17:25:48,324 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119609ms for 120000ms of delay, sleeping for 401ms
02.12.2021 17:25:48,353 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:48,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:48,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:48,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 378
02.12.2021 17:25:48,459 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:48,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:48,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:48,494 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 277
02.12.2021 17:25:48,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,559 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,559 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 212
02.12.2021 17:25:48,559 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:48,563 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:48,575 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,577 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:48,577 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=866) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:48,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 177
02.12.2021 17:25:48,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:48,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,654 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,657 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,660 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 112
02.12.2021 17:25:48,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,661 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,661 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,672 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,672 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,678 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=866): org.apache.kafka.common.requests.HeartbeatResponse@2ae4da44
02.12.2021 17:25:48,678 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:48,694 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 77
02.12.2021 17:25:48,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,712 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,712 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,729 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119688ms for 120000ms of delay, sleeping for 322ms
02.12.2021 17:25:48,758 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:48,760 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 11
02.12.2021 17:25:48,762 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:48,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,772 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,772 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,773 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:48,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,773 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=653) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null}
02.12.2021 17:25:48,773 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:48,774 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 285
02.12.2021 17:25:48,774 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=653) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null}
02.12.2021 17:25:48,775 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=653): org.apache.kafka.common.requests.HeartbeatResponse@1e1f188f
02.12.2021 17:25:48,775 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:48,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 284
02.12.2021 17:25:48,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 284
02.12.2021 17:25:48,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 21
02.12.2021 17:25:48,776 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=653): org.apache.kafka.common.requests.HeartbeatResponse@2bf774f1
02.12.2021 17:25:48,776 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:48,776 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 17
02.12.2021 17:25:48,776 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 17
02.12.2021 17:25:48,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:48,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,794 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,798 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,801 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:48,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:48,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:48,858 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,866 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:48,866 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1199) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null}
02.12.2021 17:25:48,875 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 184
02.12.2021 17:25:48,902 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:48,928 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 58942ms delay out of 60000ms. Remaining 1058ms. Executor queue at 0
02.12.2021 17:25:48,931 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59004ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:48,963 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:48,966 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1199): org.apache.kafka.common.requests.HeartbeatResponse@dd822b
02.12.2021 17:25:48,967 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:48,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:48,977 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 82
02.12.2021 17:25:49,006 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:49,041 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239901ms delay out of 240000ms. Remaining 99ms. Executor queue at 1
02.12.2021 17:25:49,046 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 10 records with 71 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 209772ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:49,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:49,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 72 iterations.
02.12.2021 17:25:49,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 72 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 209772ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:49,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:49,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,047 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 60 and memberId staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c
02.12.2021 17:25:49,047 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:49,047 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[redacted.Cloud.Message.Callback.Retry3-3], userDataSize=48)
02.12.2021 17:25:49,047 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:49,047 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:330] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Skip resuming since state is RUNNING
02.12.2021 17:25:49,048 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:49,048 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:49,048 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7] State transition from RUNNING to REBALANCING
02.12.2021 17:25:49,048 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Pausing partitions [redacted.Cloud.Message.Callback.Retry3-3]
02.12.2021 17:25:49,048 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-3 because it is paused
02.12.2021 17:25:49,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 109 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 84491ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:49,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:49,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 110 iterations.
02.12.2021 17:25:49,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 110 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 84494ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:49,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:49,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,058 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019544, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:49,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:49,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,059 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,058 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019554, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:49,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:49,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,062 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:49,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,062 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 110 iterations.
02.12.2021 17:25:49,063 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:49,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,067 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119954ms for 120000ms of delay, sleeping for 56ms
02.12.2021 17:25:49,066 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,069 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:49,106 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:49,125 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119931ms for 120000ms of delay, sleeping for 79ms
02.12.2021 17:25:49,149 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-3 because it is paused
02.12.2021 17:25:49,149 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-3 because it is paused
02.12.2021 17:25:49,149 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:49,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:49,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,157 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,158 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:49,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,161 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,162 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,169 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:49,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,173 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:49,207 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119627ms for 120000ms of delay, sleeping for 383ms
02.12.2021 17:25:49,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,213 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,214 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,249 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-3 because it is paused
02.12.2021 17:25:49,249 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-3 because it is paused
02.12.2021 17:25:49,249 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:49,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:49,262 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:49,269 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:49,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:49,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,302 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,302 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,349 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-3 because it is paused
02.12.2021 17:25:49,350 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-3 because it is paused
02.12.2021 17:25:49,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:49,358 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:49,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:49,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:49,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:49,450 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-3 because it is paused
02.12.2021 17:25:49,451 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-3 because it is paused
02.12.2021 17:25:49,451 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:49,459 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:49,463 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:49,474 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:49,503 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:49,548 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-3 because it is paused
02.12.2021 17:25:49,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:49,549 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:49,549 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:49,549 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:49,549 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Resuming partitions [redacted.Cloud.Message.Callback.Retry3-3]
02.12.2021 17:25:49,549 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:49,549 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:49,549 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:49,549 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:49,549 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7] State transition from REBALANCING to RUNNING
02.12.2021 17:25:49,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:49,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,549 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 72 iterations.
02.12.2021 17:25:49,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 72 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 210274ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:49,549 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Flushing record collector
02.12.2021 17:25:49,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Prepared RUNNING task for committing
02.12.2021 17:25:49,550 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry3-3=OffsetAndMetadata{offset=962265, leaderEpoch=null, metadata='AQAAAX1787XU'}} to coordinator kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:49,550 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1200) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry3,partitions=[{partition_index=3,committed_offset=962265,committed_leader_epoch=-1,committed_metadata=AQAAAX1787XU}]}]}
02.12.2021 17:25:49,560 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:49,563 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:49,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:49,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,566 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,567 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,572 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received OFFSET_COMMIT response from node 2147483643 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1200): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry3', partitions=[OffsetCommitResponsePartition(partitionIndex=3, errorCode=0)])])
02.12.2021 17:25:49,572 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Committed offset 962265 for partition redacted.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:49,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry3-3=962264}
02.12.2021 17:25:49,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Finalized commit for RUNNING task with eos false enforce checkpoint false
02.12.2021 17:25:49,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:684] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Committed all active tasks [0_3] and standby tasks [] in 0ms
02.12.2021 17:25:49,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,573 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962265, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:49,573 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962275, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:49,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:49,573 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-3, new queue size is 10
02.12.2021 17:25:49,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,573 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 72 iterations.
02.12.2021 17:25:49,574 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239754ms for 240000ms of delay, sleeping for 256ms
02.12.2021 17:25:49,591 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119202ms for 120000ms of delay, sleeping for 808ms
02.12.2021 17:25:49,604 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:49,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:49,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,658 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,658 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,663 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,667 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:49,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:49,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,681 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:49,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:49,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:49,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,721 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,724 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:49,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:49,767 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:49,803 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,804 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,804 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,833 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239848ms for 240000ms of delay, sleeping for 162ms
02.12.2021 17:25:49,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:49,870 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:49,864 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:49,905 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:49,957 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59863ms for 60000ms of delay, sleeping for 147ms
02.12.2021 17:25:49,965 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:49,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:49,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 187
02.12.2021 17:25:49,998 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239846ms for 240000ms of delay, sleeping for 164ms
02.12.2021 17:25:50,012 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 292
02.12.2021 17:25:50,066 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:50,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,067 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,074 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:50,112 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58243ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:50,115 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 189
02.12.2021 17:25:50,135 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=660): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', members=[])
02.12.2021 17:25:50,135 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=660): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', members=[])
02.12.2021 17:25:50,139 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', members=[])
02.12.2021 17:25:50,139 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:50,139 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=192, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}
02.12.2021 17:25:50,139 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=192, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=192, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:50,139 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=661) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null,assignments=[]}
02.12.2021 17:25:50,139 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 42
02.12.2021 17:25:50,139 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', members=[])
02.12.2021 17:25:50,141 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:50,141 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=192, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}
02.12.2021 17:25:50,141 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=192, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=192, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:50,141 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=661) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null,assignments=[]}
02.12.2021 17:25:50,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 86
02.12.2021 17:25:50,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:50,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,167 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,167 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,167 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:50,167 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 176
02.12.2021 17:25:50,175 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:50,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,182 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,182 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,188 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239857ms for 240000ms of delay, sleeping for 153ms
02.12.2021 17:25:50,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 89
02.12.2021 17:25:50,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:50,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,231 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,239 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=661): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,239 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,239 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=192, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}
02.12.2021 17:25:50,239 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 192 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a
02.12.2021 17:25:50,239 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:50,239 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:50,240 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:50,240 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:50,240 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:50,240 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7] State transition from RUNNING to REBALANCING
02.12.2021 17:25:50,240 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:50,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 443
02.12.2021 17:25:50,239 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=661): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,240 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,240 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=192, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}
02.12.2021 17:25:50,240 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 192 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39
02.12.2021 17:25:50,240 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:50,240 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:50,241 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:50,241 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:50,241 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:50,241 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:50,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 492
02.12.2021 17:25:50,269 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:50,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 73
02.12.2021 17:25:50,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 293
02.12.2021 17:25:50,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,305 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,305 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,341 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 391
02.12.2021 17:25:50,343 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239574ms for 240000ms of delay, sleeping for 436ms
02.12.2021 17:25:50,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,340 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 342
02.12.2021 17:25:50,344 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:50,345 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:50,346 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=643) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:50,348 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 323
02.12.2021 17:25:50,348 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=643): org.apache.kafka.common.requests.HeartbeatResponse@6376f590
02.12.2021 17:25:50,349 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:50,349 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 318
02.12.2021 17:25:50,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 317
02.12.2021 17:25:50,363 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:50,364 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:50,364 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=643) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:50,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 303
02.12.2021 17:25:50,364 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=643): org.apache.kafka.common.requests.HeartbeatResponse@23fb5d0c
02.12.2021 17:25:50,365 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:50,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 302
02.12.2021 17:25:50,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 302
02.12.2021 17:25:50,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 192
02.12.2021 17:25:50,400 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119994ms for 120000ms of delay, sleeping for 16ms
02.12.2021 17:25:50,405 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:50,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 110 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 85857ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:50,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:50,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 111 iterations.
02.12.2021 17:25:50,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 111 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 85859ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:50,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:50,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:50,423 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=943): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', members=[])
02.12.2021 17:25:50,424 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', members=[])
02.12.2021 17:25:50,426 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:50,426 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=192, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}
02.12.2021 17:25:50,428 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=192, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=192, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:50,431 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=944) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:50,431 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019554, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:50,433 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019564, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:50,435 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=944): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 6, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 15 ms and fetched 10 records
02.12.2021 17:25:50,439 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:50,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,439 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:50,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 111 iterations.
02.12.2021 17:25:50,440 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119939ms for 120000ms of delay, sleeping for 71ms
02.12.2021 17:25:50,441 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 291
02.12.2021 17:25:50,445 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 238
02.12.2021 17:25:50,451 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 216
02.12.2021 17:25:50,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 201
02.12.2021 17:25:50,483 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:50,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:50,513 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119718ms for 120000ms of delay, sleeping for 292ms
02.12.2021 17:25:50,532 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 6, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,533 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=192, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', protocol='stream'}
02.12.2021 17:25:50,542 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 190
02.12.2021 17:25:50,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 137
02.12.2021 17:25:50,553 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 114
02.12.2021 17:25:50,566 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 101
02.12.2021 17:25:50,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,576 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,577 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 192
02.12.2021 17:25:50,642 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:50,645 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 37
02.12.2021 17:25:50,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 13
02.12.2021 17:25:50,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,670 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,670 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,671 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:50,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:50,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:50,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:50,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:50,686 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:50,686 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:50,687 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:50,687 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:50,687 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:50,687 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:50,687 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:50,687 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:50,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:50,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,688 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,688 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 89
02.12.2021 17:25:50,733 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,733 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:50,733 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:50,733 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:50,734 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:50,734 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:50,736 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:50,736 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:50,736 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:50,736 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:50,736 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7] State transition from REBALANCING to RUNNING
02.12.2021 17:25:50,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:50,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,739 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,740 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,771 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:50,771 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:50,780 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239896ms for 240000ms of delay, sleeping for 114ms
02.12.2021 17:25:50,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:50,789 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:50,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,806 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,806 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119686ms for 120000ms of delay, sleeping for 324ms
02.12.2021 17:25:50,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,841 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:50,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:50,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:50,881 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:50,890 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:50,905 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239951ms for 240000ms of delay, sleeping for 59ms
02.12.2021 17:25:50,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:50,944 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:50,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 10 records with 72 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 73 iterations.
02.12.2021 17:25:50,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 73 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:50,968 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962275, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:50,968 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962285, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:50,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:50,969 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-3, new queue size is 10
02.12.2021 17:25:50,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,974 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:50,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:50,969 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:50,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 73 iterations.
02.12.2021 17:25:50,978 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239774ms for 240000ms of delay, sleeping for 236ms
02.12.2021 17:25:50,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:50,995 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 193
02.12.2021 17:25:51,006 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:51,044 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:51,074 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:51,077 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:51,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:51,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,088 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:51,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 84
02.12.2021 17:25:51,107 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:51,114 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59245ms delay out of 60000ms. Remaining 755ms. Executor queue at 0
02.12.2021 17:25:51,114 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58797ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:51,131 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119988ms for 120000ms of delay, sleeping for 22ms
02.12.2021 17:25:51,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:51,155 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119736ms for 120000ms of delay, sleeping for 274ms
02.12.2021 17:25:51,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,171 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,172 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,172 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,188 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:51,207 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:51,215 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239887ms for 240000ms of delay, sleeping for 123ms
02.12.2021 17:25:51,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,240 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:51,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:51,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:51,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:51,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,306 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,307 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 465
02.12.2021 17:25:51,341 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:51,341 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239499ms for 240000ms of delay, sleeping for 511ms
02.12.2021 17:25:51,372 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:51,373 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:51,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:51,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:51,407 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 365
02.12.2021 17:25:51,431 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119913ms for 120000ms of delay, sleeping for 97ms
02.12.2021 17:25:51,445 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 295
02.12.2021 17:25:51,473 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:51,473 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:51,489 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:51,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:51,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 264
02.12.2021 17:25:51,531 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119691ms for 120000ms of delay, sleeping for 319ms
02.12.2021 17:25:51,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 191
02.12.2021 17:25:51,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:51,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:51,586 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,587 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:51,588 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=867) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:51,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,589 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 182
02.12.2021 17:25:51,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:51,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 164
02.12.2021 17:25:51,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 87
02.12.2021 17:25:51,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,674 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,673 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,674 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,675 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,688 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=867): org.apache.kafka.common.requests.HeartbeatResponse@10022a98
02.12.2021 17:25:51,689 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:51,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,689 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,689 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,690 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 82
02.12.2021 17:25:51,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 63
02.12.2021 17:25:51,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,741 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,741 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,772 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,773 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:51,775 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=654) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null}
02.12.2021 17:25:51,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 318
02.12.2021 17:25:51,775 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=654): org.apache.kafka.common.requests.HeartbeatResponse@7ccca3a0
02.12.2021 17:25:51,775 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:51,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 315
02.12.2021 17:25:51,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 313
02.12.2021 17:25:51,778 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:51,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:51,773 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:51,782 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:51,784 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=654) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null}
02.12.2021 17:25:51,789 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:51,788 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 25
02.12.2021 17:25:51,792 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=654): org.apache.kafka.common.requests.HeartbeatResponse@1013384e
02.12.2021 17:25:51,796 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:51,798 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 11
02.12.2021 17:25:51,804 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 3
02.12.2021 17:25:51,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,815 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,815 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,815 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,815 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,815 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,815 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,815 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,815 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:51,842 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:51,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 111 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 87288ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:51,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:51,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 112 iterations.
02.12.2021 17:25:51,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 112 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 87289ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:51,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:51,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,851 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 192 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e
02.12.2021 17:25:51,851 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:51,851 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[redacted.Cloud.Message.Callback.Retry2-6], userDataSize=48)
02.12.2021 17:25:51,851 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:51,851 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:330] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Skip resuming since state is RUNNING
02.12.2021 17:25:51,851 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:51,851 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:51,851 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7] State transition from RUNNING to REBALANCING
02.12.2021 17:25:51,851 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Pausing partitions [redacted.Cloud.Message.Callback.Retry2-6]
02.12.2021 17:25:51,851 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-6 because it is paused
02.12.2021 17:25:51,851 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,866 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239709ms for 240000ms of delay, sleeping for 301ms
02.12.2021 17:25:51,877 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 212
02.12.2021 17:25:51,879 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:51,877 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:51,880 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1201) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null}
02.12.2021 17:25:51,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:51,890 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:51,916 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:51,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:51,952 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-6 because it is paused
02.12.2021 17:25:51,953 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-6 because it is paused
02.12.2021 17:25:51,953 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:51,978 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 112
02.12.2021 17:25:51,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:51,980 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1201): org.apache.kafka.common.requests.HeartbeatResponse@35010a57
02.12.2021 17:25:51,981 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:51,994 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 195
02.12.2021 17:25:51,990 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 184
02.12.2021 17:25:52,017 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:52,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 192
02.12.2021 17:25:52,053 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-6 because it is paused
02.12.2021 17:25:52,057 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-6 because it is paused
02.12.2021 17:25:52,065 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:52,078 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 12
02.12.2021 17:25:52,080 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:52,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,091 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,096 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,095 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:52,097 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 77
02.12.2021 17:25:52,115 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59798ms delay out of 60000ms. Remaining 202ms. Executor queue at 0
02.12.2021 17:25:52,116 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59352ms for 60000ms of delay, sleeping for 658ms
02.12.2021 17:25:52,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 192
02.12.2021 17:25:52,150 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:52,165 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-6 because it is paused
02.12.2021 17:25:52,165 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-6 because it is paused
02.12.2021 17:25:52,165 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 186
02.12.2021 17:25:52,174 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239202ms for 240000ms of delay, sleeping for 808ms
02.12.2021 17:25:52,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,175 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,176 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,177 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,175 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:52,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,193 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:52,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:52,223 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:52,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:52,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,245 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:52,266 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-6 because it is paused
02.12.2021 17:25:52,266 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-6 because it is paused
02.12.2021 17:25:52,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 85
02.12.2021 17:25:52,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:52,282 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 393
02.12.2021 17:25:52,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:52,297 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:52,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:52,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,315 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,316 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:52,352 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-6 because it is paused
02.12.2021 17:25:52,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:52,352 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:52,352 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:52,352 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:52,352 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Resuming partitions [redacted.Cloud.Message.Callback.Retry2-6]
02.12.2021 17:25:52,352 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:52,352 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:52,352 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:52,352 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:52,352 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7] State transition from REBALANCING to RUNNING
02.12.2021 17:25:52,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:52,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,352 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 112 iterations.
02.12.2021 17:25:52,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 112 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 87791ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:52,358 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Flushing record collector
02.12.2021 17:25:52,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Prepared RUNNING task for committing
02.12.2021 17:25:52,358 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry2-6=OffsetAndMetadata{offset=1019564, leaderEpoch=null, metadata='AQAAAX179ZUg'}} to coordinator kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:52,358 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=945) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry2,partitions=[{partition_index=6,committed_offset=1019564,committed_leader_epoch=-1,committed_metadata=AQAAAX179ZUg}]}]}
02.12.2021 17:25:52,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:52,378 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received OFFSET_COMMIT response from node 2147483645 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=945): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry2', partitions=[OffsetCommitResponsePartition(partitionIndex=6, errorCode=0)])])
02.12.2021 17:25:52,381 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Committed offset 1019564 for partition redacted.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:52,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry2-6=1019563}
02.12.2021 17:25:52,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Finalized commit for RUNNING task with eos false enforce checkpoint false
02.12.2021 17:25:52,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:684] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Committed all active tasks [0_6] and standby tasks [] in 0ms
02.12.2021 17:25:52,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:52,381 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019564, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:52,381 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019574, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:52,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:52,386 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:52,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:52,386 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 112 iterations.
02.12.2021 17:25:52,394 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:52,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:52,416 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:52,420 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119353ms for 120000ms of delay, sleeping for 657ms
02.12.2021 17:25:52,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:52,481 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:52,488 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 187
02.12.2021 17:25:52,494 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:52,499 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:52,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:52,554 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 191
02.12.2021 17:25:52,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:52,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:52,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:52,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:52,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,600 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30280ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:52,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,600 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:52,657 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 88
02.12.2021 17:25:52,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,681 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,681 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,682 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,683 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,695 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,695 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 444
02.12.2021 17:25:52,693 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,700 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:52,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:52,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,746 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,747 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 394
02.12.2021 17:25:52,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 10 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:52,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 0 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:52,777 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 6 fetched records at offset FetchPosition{offset=1129655, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:52,777 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1129661, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:52,777 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:1199] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Added READ_UNCOMMITTED fetch request for partition redacted.Cloud.Message.Callback.Retry1-4 at position FetchPosition{offset=1129661, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null)], epoch=absent}} to node kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null)
02.12.2021 17:25:52,777 DEBUG [org.apache.kafka.clients.FetchSessionHandler:259] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Built incremental fetch (sessionId=1712989867, epoch=168) for node 2. Added (), altered (redacted.Cloud.Message.Callback.Retry1-4), removed () out of (OSS.STAGING.Cloud.Message.Callback.Retry1-4)
02.12.2021 17:25:52,777 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:266] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(redacted.Cloud.Message.Callback.Retry1-4), toForget=(), implied=()) to broker kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null)
02.12.2021 17:25:52,777 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending FETCH request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=868) and timeout 30000 to node 2: {replica_id=-1,max_wait_ms=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1712989867,session_epoch=168,topics=[{topic=redacted.Cloud.Message.Callback.Retry1,partitions=[{partition=4,current_leader_epoch=-1,fetch_offset=1129661,log_start_offset=-1,partition_max_bytes=1048576}]}],forgotten_topics_data=[],rack_id=}
02.12.2021 17:25:52,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 6 records
02.12.2021 17:25:52,778 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-4, new queue size is 6
02.12.2021 17:25:52,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,778 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:52,778 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59767ms for 60000ms of delay, sleeping for 243ms
02.12.2021 17:25:52,782 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:52,791 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received FETCH response from node 2 for request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=868): org.apache.kafka.common.requests.FetchResponse@84fece2
02.12.2021 17:25:52,791 DEBUG [org.apache.kafka.clients.FetchSessionHandler:463] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Node 2 sent an incremental fetch response with throttleTimeMs = 0 for session 1712989867 with response=(redacted.Cloud.Message.Callback.Retry1-4)
02.12.2021 17:25:52,791 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:315] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Fetch READ_UNCOMMITTED at offset 1129661 for partition redacted.Cloud.Message.Callback.Retry1-4 returned fetch data (error=NONE, highWaterMark=1129829, lastStableOffset = 1129829, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, divergingEpoch =Optional.empty, recordsSizeInBytes=76330)
02.12.2021 17:25:52,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 344
02.12.2021 17:25:52,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:52,801 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:52,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:52,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,819 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30157ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:52,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:52,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:52,896 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:52,896 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 244
02.12.2021 17:25:52,902 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:52,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:52,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 194
02.12.2021 17:25:52,986 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239106ms for 240000ms of delay, sleeping for 904ms
02.12.2021 17:25:52,990 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:53,009 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:53,013 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 126
02.12.2021 17:25:53,013 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 181
02.12.2021 17:25:53,020 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:53,025 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59894ms for 60000ms of delay, sleeping for 116ms
02.12.2021 17:25:53,055 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 86
02.12.2021 17:25:53,086 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118942ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:53,090 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:53,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,100 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 25
02.12.2021 17:25:53,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 79
02.12.2021 17:25:53,120 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:53,139 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,139 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,139 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 192 and member id staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,139 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=662) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null}
02.12.2021 17:25:53,139 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 56
02.12.2021 17:25:53,140 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=662): org.apache.kafka.common.requests.HeartbeatResponse@3a2f0376
02.12.2021 17:25:53,140 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:53,140 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 192 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a
02.12.2021 17:25:53,140 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:53,140 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:53,140 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 84, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,141 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=663) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:53,141 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,141 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 192 and member id staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,141 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=662) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null}
02.12.2021 17:25:53,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,142 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 53
02.12.2021 17:25:53,142 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 105
02.12.2021 17:25:53,142 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=662): org.apache.kafka.common.requests.HeartbeatResponse@7ed15898
02.12.2021 17:25:53,142 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:53,142 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 192 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39
02.12.2021 17:25:53,142 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:53,142 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:53,142 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59111ms for 60000ms of delay, sleeping for 899ms
02.12.2021 17:25:53,142 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 84, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,143 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=663) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:53,143 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 104
02.12.2021 17:25:53,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:53,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,184 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 179
02.12.2021 17:25:53,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:53,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,193 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 151
02.12.2021 17:25:53,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,195 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,195 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,201 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:53,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:53,239 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:53,242 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:53,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,248 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,248 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,284 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 79
02.12.2021 17:25:53,294 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 50
02.12.2021 17:25:53,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:53,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,320 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,344 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,344 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:53,344 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=644) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:53,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,345 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=644): org.apache.kafka.common.requests.HeartbeatResponse@4db4a886
02.12.2021 17:25:53,346 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:53,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 347
02.12.2021 17:25:53,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 346
02.12.2021 17:25:53,364 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,364 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:53,364 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=644) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:53,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 320
02.12.2021 17:25:53,365 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=644): org.apache.kafka.common.requests.HeartbeatResponse@72ac8d9e
02.12.2021 17:25:53,367 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:53,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 317
02.12.2021 17:25:53,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 317
02.12.2021 17:25:53,402 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:53,420 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:53,448 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 245
02.12.2021 17:25:53,468 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 216
02.12.2021 17:25:53,489 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,489 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 192 and member id staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,489 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=946) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null}
02.12.2021 17:25:53,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:53,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:53,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 144
02.12.2021 17:25:53,569 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 115
02.12.2021 17:25:53,590 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=946): org.apache.kafka.common.requests.HeartbeatResponse@677d6e57
02.12.2021 17:25:53,590 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:53,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,601 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,621 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:53,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 44
02.12.2021 17:25:53,671 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 13
02.12.2021 17:25:53,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,685 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,685 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:53,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:53,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,695 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,696 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,697 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:53,702 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:53,722 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:53,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,749 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,749 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,785 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:53,799 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:53,802 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:53,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,822 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,829 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:53,912 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239301ms for 240000ms of delay, sleeping for 709ms
02.12.2021 17:25:53,909 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 193
02.12.2021 17:25:53,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 291
02.12.2021 17:25:53,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 396
02.12.2021 17:25:53,993 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:54,015 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 87
02.12.2021 17:25:54,021 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 176
02.12.2021 17:25:54,040 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 289
02.12.2021 17:25:54,047 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59963ms for 60000ms of delay, sleeping for 47ms
02.12.2021 17:25:54,087 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119943ms delay out of 120000ms. Remaining 57ms. Executor queue at 0
02.12.2021 17:25:54,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 112 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:54,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 113 iterations.
02.12.2021 17:25:54,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 113 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:54,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:54,087 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 192 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e
02.12.2021 17:25:54,088 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:54,088 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:54,089 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 79, -42, -53, 34, -15, 36, 73, 71, -94, -95, -12, 90, 118, 112, 120, -25, 0, 0, 0, 0, 0, 0, 0, 0, 84, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 6])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:54,089 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, correlationId=947) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer-a3e966fa-c26c-4f09-bc87-7eed96ada69e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:54,091 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:54,090 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019574, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:54,091 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019584, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:54,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 4 ms and fetched 10 records
02.12.2021 17:25:54,094 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:54,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,094 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:54,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 113 iterations.
02.12.2021 17:25:54,094 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119444ms for 120000ms of delay, sleeping for 566ms
02.12.2021 17:25:54,097 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59098ms for 60000ms of delay, sleeping for 912ms
02.12.2021 17:25:54,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:54,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:54,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,110 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,110 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:54,125 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 72
02.12.2021 17:25:54,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 188
02.12.2021 17:25:54,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,186 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,197 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,198 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,211 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:54,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 88
02.12.2021 17:25:54,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,250 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,250 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:54,298 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:54,312 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:54,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,330 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 443
02.12.2021 17:25:54,387 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:54,398 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:54,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:54,431 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 343
02.12.2021 17:25:54,487 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:54,498 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:54,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:54,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 242
02.12.2021 17:25:54,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:54,594 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,594 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:54,594 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=869) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:54,599 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:54,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:54,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,612 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,612 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 160
02.12.2021 17:25:54,623 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239522ms for 240000ms of delay, sleeping for 488ms
02.12.2021 17:25:54,632 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 141
02.12.2021 17:25:54,662 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119810ms for 120000ms of delay, sleeping for 200ms
02.12.2021 17:25:54,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,687 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,688 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,695 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=869): org.apache.kafka.common.requests.HeartbeatResponse@1b3e35ad
02.12.2021 17:25:54,696 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:54,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,698 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,699 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,699 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,699 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,713 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 59
02.12.2021 17:25:54,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 40
02.12.2021 17:25:54,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,751 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,751 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,773 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,773 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:54,773 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=655) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null}
02.12.2021 17:25:54,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,773 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,773 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:54,773 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=655) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null}
02.12.2021 17:25:54,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 339
02.12.2021 17:25:54,774 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=655): org.apache.kafka.common.requests.HeartbeatResponse@49b2e858
02.12.2021 17:25:54,774 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=655): org.apache.kafka.common.requests.HeartbeatResponse@37f47b83
02.12.2021 17:25:54,775 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:54,775 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:54,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 337
02.12.2021 17:25:54,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 55
02.12.2021 17:25:54,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 55
02.12.2021 17:25:54,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 337
02.12.2021 17:25:54,789 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:54,799 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:54,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,830 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:54,875 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 237
02.12.2021 17:25:54,871 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119990ms for 120000ms of delay, sleeping for 20ms
02.12.2021 17:25:54,888 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,888 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:54,888 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1202) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null}
02.12.2021 17:25:54,891 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:54,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:54,910 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119097ms for 120000ms of delay, sleeping for 913ms
02.12.2021 17:25:54,931 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:54,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 136
02.12.2021 17:25:54,989 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1202): org.apache.kafka.common.requests.HeartbeatResponse@2608d173
02.12.2021 17:25:54,989 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:54,995 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:55,001 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:55,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 6 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:55,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:55,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 0 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:55,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:55,015 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1251] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Preparing to read 76330 bytes of data for partition redacted.Cloud.Message.Callback.Retry1-4 with offset FetchPosition{offset=1129661, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null)], epoch=absent}}
02.12.2021 17:25:55,016 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1275] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Updating high watermark for partition redacted.Cloud.Message.Callback.Retry1-4 to 1129829
02.12.2021 17:25:55,016 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1280] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Updating log start offset for partition redacted.Cloud.Message.Callback.Retry1-4 to 0
02.12.2021 17:25:55,016 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1285] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Updating last stable offset for partition redacted.Cloud.Message.Callback.Retry1-4 to 1129829
02.12.2021 17:25:55,016 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1129661, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:55,016 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1129671, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:55,016 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:55,017 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-4, new queue size is 10
02.12.2021 17:25:55,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,017 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:55,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:55,021 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59840ms for 60000ms of delay, sleeping for 170ms
02.12.2021 17:25:55,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:55,078 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 34
02.12.2021 17:25:55,095 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:55,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 10 records with 73 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:55,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 74 iterations.
02.12.2021 17:25:55,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 74 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:55,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:55,114 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962285, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:55,114 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962295, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:55,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:55,114 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-3, new queue size is 10
02.12.2021 17:25:55,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,114 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:55,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 74 iterations.
02.12.2021 17:25:55,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,117 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 85
02.12.2021 17:25:55,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,118 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239868ms for 240000ms of delay, sleeping for 142ms
02.12.2021 17:25:55,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:55,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,189 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,193 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59130ms for 60000ms of delay, sleeping for 880ms
02.12.2021 17:25:55,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,200 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:55,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,203 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,203 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:55,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:55,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,252 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,262 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239095ms for 240000ms of delay, sleeping for 915ms
02.12.2021 17:25:55,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:55,304 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:55,318 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:55,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,332 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:55,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:55,419 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:55,433 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:55,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:55,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:55,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:55,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:55,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:55,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:55,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:55,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,619 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,619 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,634 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:55,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,690 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,691 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,691 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,691 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,691 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,691 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,692 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,704 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,704 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,705 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,706 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:55,737 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:55,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,753 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,753 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,793 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:55,804 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:55,821 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:55,830 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119953ms for 120000ms of delay, sleeping for 57ms
02.12.2021 17:25:55,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,840 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,841 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,849 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,897 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:55,905 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:55,901 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119719ms for 120000ms of delay, sleeping for 291ms
02.12.2021 17:25:55,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:55,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:55,998 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:56,006 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:56,023 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:56,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:56,079 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59619ms for 60000ms of delay, sleeping for 391ms
02.12.2021 17:25:56,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:56,108 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:56,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,119 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,119 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,150 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:56,184 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239015ms for 240000ms of delay, sleeping for 995ms
02.12.2021 17:25:56,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,192 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 171
02.12.2021 17:25:56,198 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119903ms for 120000ms of delay, sleeping for 107ms
02.12.2021 17:25:56,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,204 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 140
02.12.2021 17:25:56,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,207 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,207 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,207 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,207 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,207 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,207 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,207 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,219 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:56,251 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:56,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,254 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 70
02.12.2021 17:25:56,305 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 40
02.12.2021 17:25:56,307 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119948ms for 120000ms of delay, sleeping for 62ms
02.12.2021 17:25:56,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:56,345 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:56,349 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:56,349 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=645) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:56,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,349 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 355
02.12.2021 17:25:56,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,349 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=645): org.apache.kafka.common.requests.HeartbeatResponse@66ab8981
02.12.2021 17:25:56,350 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:56,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,351 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 354
02.12.2021 17:25:56,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 352
02.12.2021 17:25:56,363 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:56,363 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:56,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,364 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=645) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:56,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 326
02.12.2021 17:25:56,367 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=645): org.apache.kafka.common.requests.HeartbeatResponse@2c29b320
02.12.2021 17:25:56,367 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:56,368 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 325
02.12.2021 17:25:56,373 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 319
02.12.2021 17:25:56,376 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119713ms for 120000ms of delay, sleeping for 297ms
02.12.2021 17:25:56,420 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:56,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:56,455 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 249
02.12.2021 17:25:56,471 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59428ms for 60000ms of delay, sleeping for 582ms
02.12.2021 17:25:56,473 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 219
02.12.2021 17:25:56,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:56,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:56,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 147
02.12.2021 17:25:56,574 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 118
02.12.2021 17:25:56,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,620 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:56,657 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 47
02.12.2021 17:25:56,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 10 records with 113 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:56,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 114 iterations.
02.12.2021 17:25:56,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processed 0 records with 114 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:56,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:56,675 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 17
02.12.2021 17:25:56,675 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1019584, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:56,676 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1019594, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-6
02.12.2021 17:25:56,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:56,678 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-6, new queue size is 10
02.12.2021 17:25:56,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,678 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:56,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-1] Processing tasks with 114 iterations.
02.12.2021 17:25:56,681 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118881ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:56,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,693 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,693 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:56,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:56,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,706 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,709 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,715 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:56,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:56,753 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:56,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,755 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,794 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:56,816 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 393
02.12.2021 17:25:56,824 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:56,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,853 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,894 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:56,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 289
02.12.2021 17:25:56,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:56,958 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 396
02.12.2021 17:25:56,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:57,026 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 184
02.12.2021 17:25:57,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 89
02.12.2021 17:25:57,054 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59818ms for 60000ms of delay, sleeping for 192ms
02.12.2021 17:25:57,058 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:57,102 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:57,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,120 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:57,126 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:57,158 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:57,181 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239996ms for 240000ms of delay, sleeping for 14ms
02.12.2021 17:25:57,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,194 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 10 records with 74 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:57,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 75 iterations.
02.12.2021 17:25:57,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processed 0 records with 75 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:57,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:57,197 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962295, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:57,198 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962305, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-3
02.12.2021 17:25:57,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:57,199 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-3, new queue size is 10
02.12.2021 17:25:57,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,199 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:57,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1] Processing tasks with 75 iterations.
02.12.2021 17:25:57,200 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239982ms for 240000ms of delay, sleeping for 28ms
02.12.2021 17:25:57,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,210 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,210 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:57,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,216 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,216 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:57,230 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239159ms for 240000ms of delay, sleeping for 851ms
02.12.2021 17:25:57,248 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59511ms for 60000ms of delay, sleeping for 499ms
02.12.2021 17:25:57,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:57,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:57,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,259 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,295 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:57,310 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:57,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:57,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:57,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,359 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 414
02.12.2021 17:25:57,395 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:57,411 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:57,422 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:57,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 311
02.12.2021 17:25:57,495 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:57,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:57,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:57,563 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 210
02.12.2021 17:25:57,596 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:57,609 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,609 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:57,610 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=870) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer-7e5a31ab-2985-4e51-9a7c-9223ab1b255f,group_instance_id=null}
02.12.2021 17:25:57,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:57,621 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,622 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,622 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 151
02.12.2021 17:25:57,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 110
02.12.2021 17:25:57,683 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119883ms delay out of 120000ms. Remaining 117ms. Executor queue at 0
02.12.2021 17:25:57,683 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119871ms for 120000ms of delay, sleeping for 139ms
02.12.2021 17:25:57,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,694 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,695 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,710 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, correlationId=870): org.apache.kafka.common.requests.HeartbeatResponse@1704ea74
02.12.2021 17:25:57,711 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:57,713 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:57,713 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,713 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,714 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,718 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,718 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 47
02.12.2021 17:25:57,749 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59957ms for 60000ms of delay, sleeping for 53ms
02.12.2021 17:25:57,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,760 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,762 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 9
02.12.2021 17:25:57,773 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,775 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:57,775 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=656) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer-b9ffa9f5-f1e3-41dd-abf8-432da904d3ce,group_instance_id=null}
02.12.2021 17:25:57,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:57,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 84
02.12.2021 17:25:57,775 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:57,781 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:57,781 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, correlationId=656): org.apache.kafka.common.requests.HeartbeatResponse@2728e4bd
02.12.2021 17:25:57,782 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:57,782 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 77
02.12.2021 17:25:57,782 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=656) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer-e6f2aeff-dff7-4070-a5ab-67dfff58a477,group_instance_id=null}
02.12.2021 17:25:57,783 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 340
02.12.2021 17:25:57,783 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, correlationId=656): org.apache.kafka.common.requests.HeartbeatResponse@7c752552
02.12.2021 17:25:57,783 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:57,783 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 76
02.12.2021 17:25:57,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 339
02.12.2021 17:25:57,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:57,789 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 333
02.12.2021 17:25:57,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 10 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:57,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:57,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processed 0 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:57,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:57,807 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1129671, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:57,815 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:57,807 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1129681, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-4
02.12.2021 17:25:57,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Main Consumer poll completed in 9 ms and fetched 10 records
02.12.2021 17:25:57,820 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-4, new queue size is 10
02.12.2021 17:25:57,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,820 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:57,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:57,820 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59708ms for 60000ms of delay, sleeping for 302ms
02.12.2021 17:25:57,823 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119997ms for 120000ms of delay, sleeping for 13ms
02.12.2021 17:25:57,851 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119750ms for 120000ms of delay, sleeping for 260ms
02.12.2021 17:25:57,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:57,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,862 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:57,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:57,895 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,896 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:57,897 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 225
02.12.2021 17:25:57,896 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1203) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer-61727c3e-fad3-4e13-9fa1-1d2c6005d78c,group_instance_id=null}
02.12.2021 17:25:57,916 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:57,962 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:57,995 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:57,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 125
02.12.2021 17:25:57,999 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, correlationId=1203): org.apache.kafka.common.requests.HeartbeatResponse@7c26d0a1
02.12.2021 17:25:57,999 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:58,016 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:58,063 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:58,089 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238610ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:58,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 24
02.12.2021 17:25:58,097 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:58,113 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119162ms for 120000ms of delay, sleeping for 848ms
02.12.2021 17:25:58,117 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:58,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,122 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,130 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,131 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59124ms for 60000ms of delay, sleeping for 886ms
02.12.2021 17:25:58,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:58,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:58,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,203 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,203 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,214 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,214 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:58,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,220 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:58,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:58,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,263 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:58,304 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:58,315 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:58,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:58,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,365 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:58,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:58,430 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 200
02.12.2021 17:25:58,468 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 397
02.12.2021 17:25:58,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:58,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:58,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:58,568 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:58,604 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:58,616 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:58,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,631 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,631 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,668 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:58,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:58,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,705 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,706 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,714 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,715 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,722 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,722 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:58,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,765 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,768 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:58,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:58,815 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:58,832 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:58,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:58,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,867 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,907 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:58,916 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:58,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:58,964 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119790ms for 120000ms of delay, sleeping for 220ms
02.12.2021 17:25:58,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 397
02.12.2021 17:25:59,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:59,017 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:59,019 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59968ms for 60000ms of delay, sleeping for 42ms
02.12.2021 17:25:59,040 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:59,062 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59790ms for 60000ms of delay, sleeping for 220ms
02.12.2021 17:25:59,071 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:59,092 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239613ms delay out of 240000ms. Remaining 387ms. Executor queue at 0
02.12.2021 17:25:59,093 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239195ms for 240000ms of delay, sleeping for 815ms
02.12.2021 17:25:59,111 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:59,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:59,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,132 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,132 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,172 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:59,186 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119861ms for 120000ms of delay, sleeping for 149ms
02.12.2021 17:25:59,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,206 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 157
02.12.2021 17:25:59,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,215 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 130
02.12.2021 17:25:59,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:59,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,226 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:59,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,266 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:59,284 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59269ms for 60000ms of delay, sleeping for 741ms
02.12.2021 17:25:59,307 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 56
02.12.2021 17:25:59,315 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 30
02.12.2021 17:25:59,336 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119228ms for 120000ms of delay, sleeping for 782ms
02.12.2021 17:25:59,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:59,346 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:59,347 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:59,347 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=646) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer-a5edddc1-bb19-4385-a586-20d13ade2010,group_instance_id=null}
02.12.2021 17:25:59,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,348 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 367
02.12.2021 17:25:59,348 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, correlationId=646): org.apache.kafka.common.requests.HeartbeatResponse@2efaa7d9
02.12.2021 17:25:59,350 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:59,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 365
02.12.2021 17:25:59,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 365
02.12.2021 17:25:59,360 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=663): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', members=[])
02.12.2021 17:25:59,360 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', members=[])
02.12.2021 17:25:59,360 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:59,360 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=193, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}
02.12.2021 17:25:59,360 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=663): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', members=[])
02.12.2021 17:25:59,361 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=193, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=193, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:59,363 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:59,365 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:59,365 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=646) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer-b4b9b965-6bf3-4ed4-a960-3d53622f02d6,group_instance_id=null}
02.12.2021 17:25:59,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 341
02.12.2021 17:25:59,362 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=664) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=193,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a,group_instance_id=null,assignments=[]}
02.12.2021 17:25:59,362 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', members=[])
02.12.2021 17:25:59,366 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:59,365 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, correlationId=646): org.apache.kafka.common.requests.HeartbeatResponse@2251a566
02.12.2021 17:25:59,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 361
02.12.2021 17:25:59,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,368 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,366 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:59,366 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=193, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}
02.12.2021 17:25:59,371 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 340
02.12.2021 17:25:59,371 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 335
02.12.2021 17:25:59,371 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=193, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=193, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:59,372 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=664) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=193,member_id=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39,group_instance_id=null,assignments=[]}
02.12.2021 17:25:59,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 392
02.12.2021 17:25:59,392 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, correlationId=664): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,392 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, correlationId=664): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,393 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,393 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=193, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a', protocol='stream'}
02.12.2021 17:25:59,392 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,393 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=193, memberId='staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39', protocol='stream'}
02.12.2021 17:25:59,393 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 193 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer-a7884997-f917-4122-9c6a-7908d248db9a
02.12.2021 17:25:59,393 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 193 and memberId staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer-701a68e4-aed9-4943-afcc-9aa1b58e9e39
02.12.2021 17:25:59,393 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:59,394 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:59,394 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:59,394 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:59,394 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:59,394 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7] State transition from RUNNING to REBALANCING
02.12.2021 17:25:59,394 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:59,393 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:59,395 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:59,395 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:59,395 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:59,395 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:59,395 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:59,395 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 374
02.12.2021 17:25:59,395 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 333
02.12.2021 17:25:59,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:59,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 263
02.12.2021 17:25:59,469 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:59,472 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 234
02.12.2021 17:25:59,495 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 231
02.12.2021 17:25:59,495 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 271
02.12.2021 17:25:59,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:59,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 163
02.12.2021 17:25:59,569 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:59,572 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 134
02.12.2021 17:25:59,596 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 131
02.12.2021 17:25:59,596 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 170
02.12.2021 17:25:59,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,633 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 62
02.12.2021 17:25:59,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:59,673 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 33
02.12.2021 17:25:59,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 70
02.12.2021 17:25:59,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 30
02.12.2021 17:25:59,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,713 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,713 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,713 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,713 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,713 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,713 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,713 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,713 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:59,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,716 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,718 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:59,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:59,731 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:59,731 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:59,733 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:59,733 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:59,733 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:59,733 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:59,733 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:59,734 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:59,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:59,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,734 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,735 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:59,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:59,767 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:59,767 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:59,767 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:59,767 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:59,767 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:59,767 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:59,767 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:59,767 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:59,767 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7] State transition from REBALANCING to RUNNING
02.12.2021 17:25:59,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:59,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,767 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,767 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,770 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:59,814 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:59,818 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:59,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:59,835 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:59,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,873 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,867 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:59,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,909 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239715ms for 240000ms of delay, sleeping for 295ms
02.12.2021 17:25:59,914 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:59,918 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-30bc77de-f72b-4705-b03a-9b7a94e570dc-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:59,945 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 290
02.12.2021 17:25:59,945 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 188
02.12.2021 17:25:59,974 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-4fd6cb22-f124-4947-a2a1-f45a767078e7-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 293
02.12.2021 17:25:59,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-b340ff38-2a93-4102-8a87-c026f0ab26f7-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 396